-- Logs begin at Fri 2021-04-30 03:37:43 UTC, end at Fri 2021-04-30 06:04:42 UTC. -- Apr 30 04:09:03.852513 n-d-763928-2 systemd[1]: Started Devstack devstack@n-super-cond.service. Apr 30 04:09:07.342880 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_db.sqlalchemy.engines [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 04:09:07.566868 n-d-763928-2 nova-conductor[79963]: DEBUG nova.context [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) {{(pid=79963) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 04:09:07.570902 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_concurrency.lockutils [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:09:07.572372 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_concurrency.lockutils [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:09:07.573106 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_concurrency.lockutils [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:09:07.574993 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_concurrency.lockutils [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:09:07.603213 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_db.sqlalchemy.engines [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 04:09:07.606184 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_db.sqlalchemy.engines [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 04:09:07.618137 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_concurrency.lockutils [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Acquired lock "singleton_lock" {{(pid=79963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 30 04:09:07.618644 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_concurrency.lockutils [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Releasing lock "singleton_lock" {{(pid=79963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 30 04:09:07.619363 n-d-763928-2 nova-conductor[79963]: INFO oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Starting 2 workers Apr 30 04:09:07.624058 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Started child 80830 {{(pid=79963) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Apr 30 04:09:07.628930 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Started child 80831 {{(pid=79963) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Apr 30 04:09:07.630154 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Full set of CONF: {{(pid=79963) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Apr 30 04:09:07.630598 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ******************************************************************************** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 04:09:07.630934 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] Configuration options gathered from: {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 04:09:07.631482 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 04:09:07.631934 n-d-763928-2 nova-conductor[80830]: INFO nova.service [-] Starting conductor node (version 23.1.0) Apr 30 04:09:07.632498 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] config files: ['/etc/nova/nova.conf'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 04:09:07.632585 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ================================================================================ {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 04:09:07.633305 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] allow_resize_to_same_host = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.633821 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] arq_binding_timeout = 300 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.634281 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] block_device_allocate_retries = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.634707 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] block_device_allocate_retries_interval = 3 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.635192 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cert = self.pem {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.635659 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute_driver = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.636176 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute_monitors = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.639906 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] config_dir = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.640427 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] config_drive_format = iso9660 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.640774 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.641207 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] config_source = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.645577 n-d-763928-2 nova-conductor[80831]: INFO nova.service [-] Starting conductor node (version 23.1.0) Apr 30 04:09:07.655091 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] console_host = n-d-763928-2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.655091 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] control_exchange = nova {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.655091 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cpu_allocation_ratio = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.655091 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] daemon = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.655091 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] debug = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.655091 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] default_access_ip_network_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.655091 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] default_availability_zone = nova {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.655626 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] default_ephemeral_format = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.655626 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.656260 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] default_schedule_zone = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.656716 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] disk_allocation_ratio = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.657136 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] enable_new_services = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.657614 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] enabled_apis = ['osapi_compute'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.658005 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] enabled_ssl_apis = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.658411 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] flat_injected = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.658825 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] force_config_drive = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.659230 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] force_raw_images = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.659639 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] graceful_shutdown_timeout = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.660055 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] heal_instance_info_cache_interval = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.662180 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] host = n-d-763928-2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.662180 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.662180 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] initial_disk_allocation_ratio = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.662409 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] initial_ram_allocation_ratio = 1.5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.663014 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.663408 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] instance_build_timeout = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.663833 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] instance_delete_interval = 300 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.664277 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] instance_format = [instance: %(uuid)s] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.664747 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] instance_name_template = instance-%08x {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.665126 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] instance_usage_audit = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.665551 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] instance_usage_audit_period = month {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.666546 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.666546 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] instances_path = /opt/stack/data/nova/instances {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.666862 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] internal_service_availability_zone = internal {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.667139 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] key = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.667531 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] live_migration_retry_count = 30 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.667937 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] log_config_append = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.676436 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_db.sqlalchemy.engines [None req-0ba6b920-3718-4292-944e-814c61bc82fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 04:09:07.676740 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.677886 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] log_dir = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.678260 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] log_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.678593 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] log_options = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.679000 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] log_rotate_interval = 1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.679493 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] log_rotate_interval_type = days {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.679892 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] log_rotation_type = none {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.680231 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.680588 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.681004 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.681433 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.681765 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.682195 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] long_rpc_timeout = 1800 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.682589 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] max_concurrent_builds = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.683056 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] max_concurrent_live_migrations = 1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.683363 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] max_concurrent_snapshots = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.683785 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] max_local_block_devices = 3 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.684191 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] max_logfile_count = 30 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.684606 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] max_logfile_size_mb = 200 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.685000 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] maximum_instance_delete_attempts = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.685420 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] metadata_listen = 0.0.0.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.685891 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] metadata_listen_port = 8775 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.688922 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] metadata_workers = 2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.689325 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] migrate_max_retries = -1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.689742 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] mkisofs_cmd = genisoimage {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.695424 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] my_block_storage_ip = 10.222.0.18 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.695823 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] my_ip = 10.222.0.18 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.696244 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] network_allocate_retries = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.696717 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.697132 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] osapi_compute_listen = 0.0.0.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.697531 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] osapi_compute_listen_port = 8774 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.697957 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] osapi_compute_unique_server_name_scope = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.698340 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] osapi_compute_workers = 2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.698731 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] password_length = 12 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.699119 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] periodic_enable = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.699511 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] periodic_fuzzy_delay = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.699973 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] pointer_model = usbtablet {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.712025 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] preallocate_images = none {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.712895 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] publish_errors = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.712991 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] pybasedir = /opt/stack/nova {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.713379 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ram_allocation_ratio = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.713810 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] rate_limit_burst = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.714248 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] rate_limit_except_level = CRITICAL {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.714671 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] rate_limit_interval = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.715109 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] reboot_timeout = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.715518 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] reclaim_instance_interval = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.715928 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] record = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.716557 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] report_interval = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.716979 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] rescue_timeout = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.717777 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] reserved_host_cpus = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.717777 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] reserved_host_disk_mb = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.718171 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] reserved_host_memory_mb = 512 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.718611 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] reserved_huge_pages = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.719012 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] resize_confirm_window = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.719414 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] resize_fs_using_block_device = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.726559 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_db.sqlalchemy.engines [None req-c73a39f7-5a2f-48c2-aee3-1491e0546e61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 04:09:07.731092 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] resume_guests_state_on_host_boot = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.731829 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.733350 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] rpc_response_timeout = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.734279 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] run_external_periodic_tasks = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.734908 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] running_deleted_instance_action = reap {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.735564 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.736247 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] running_deleted_instance_timeout = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.736869 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler_instance_sync_interval = 120 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.737465 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_down_time = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.738224 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] servicegroup_driver = db {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.738851 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] shelved_offload_time = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.739464 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] shelved_poll_interval = 3600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.740212 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] shutdown_timeout = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.740922 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] source_is_ipv6 = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.741526 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ssl_only = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.742185 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] state_path = /opt/stack/data/nova {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.743468 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] sync_power_state_interval = 600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.744282 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] sync_power_state_pool_size = 1000 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.744924 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] syslog_log_facility = LOG_USER {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.745511 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] tempdir = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.746137 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] timeout_nbd = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.748784 n-d-763928-2 nova-conductor[80830]: DEBUG nova.service [None req-0ba6b920-3718-4292-944e-814c61bc82fd None None] Creating RPC server for service conductor {{(pid=80830) start /opt/stack/nova/nova/service.py:182}} Apr 30 04:09:07.758152 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] transport_url = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.758880 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] update_resources_interval = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.760120 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] use_cow_images = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.761875 n-d-763928-2 nova-conductor[80831]: DEBUG nova.service [None req-c73a39f7-5a2f-48c2-aee3-1491e0546e61 None None] Creating RPC server for service conductor {{(pid=80831) start /opt/stack/nova/nova/service.py:182}} Apr 30 04:09:07.762429 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] use_eventlog = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.763069 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] use_journal = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.764426 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] use_json = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.765163 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] use_rootwrap_daemon = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.765933 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] use_stderr = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.766556 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] use_syslog = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.767172 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vcpu_pin_set = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.767810 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vif_plugging_is_fatal = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.768441 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vif_plugging_timeout = 300 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.769087 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] virt_mkfs = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.769682 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] volume_usage_poll_interval = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.770310 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] watch_log_file = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.771515 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] web = /usr/share/spice-html5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 04:09:07.772232 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_concurrency.disable_process_locking = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.772891 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.774183 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.auth_strategy = keystone {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.774810 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.compute_link_prefix = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.775526 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.776250 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.dhcp_domain = novalocal {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.776889 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.enable_instance_password = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.777482 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.glance_link_prefix = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.778084 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.778735 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.779356 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.instance_list_per_project_cells = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.779948 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.list_records_by_skipping_down_cells = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.780573 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.local_metadata_per_cell = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.781209 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.max_limit = 1000 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.781816 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.metadata_cache_expiration = 15 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.782483 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.neutron_default_tenant_id = default {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.783084 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.use_forwarded_for = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.784031 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.use_neutron_default_nets = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.784731 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.785456 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.786240 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.786923 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.787540 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.vendordata_dynamic_targets = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.788130 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.vendordata_jsonfile_path = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.788760 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.789452 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.backend = dogpile.cache.memcached {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.790068 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.backend_argument = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.790962 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.config_prefix = cache.oslo {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.791641 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.debug_cache_backend = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.793180 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.enabled = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.794776 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.expiration_time = 600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.795587 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.memcache_dead_retry = 300 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.796371 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.796976 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.797611 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.memcache_pool_maxsize = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.798204 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.798865 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.799550 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.memcache_socket_timeout = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.800422 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.proxies = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.801277 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.tls_allowed_ciphers = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.801875 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.tls_cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.803210 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.tls_certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.803969 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.tls_enabled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.805000 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cache.tls_keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.805792 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.auth_section = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.806571 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.auth_type = password {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.807172 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.807936 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.catalog_info = volumev3::publicURL {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.808589 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.809233 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.809862 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.cross_az_attach = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.810470 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.endpoint_template = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.812761 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.http_retries = 3 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.814201 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.815261 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.816658 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.os_region_name = RegionOne {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.817792 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.818929 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cinder.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.819710 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.820376 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.cpu_dedicated_set = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.821664 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.cpu_shared_set = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.822974 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.image_type_exclude_list = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.823722 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.824505 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.825679 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.826695 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.827372 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.resource_provider_association_refresh = 300 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.827733 n-d-763928-2 nova-conductor[80831]: DEBUG nova.service [None req-c73a39f7-5a2f-48c2-aee3-1491e0546e61 None None] Join ServiceGroup membership for this service conductor {{(pid=80831) start /opt/stack/nova/nova/service.py:199}} Apr 30 04:09:07.828349 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] compute.shutdown_retry_interval = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.828901 n-d-763928-2 nova-conductor[80830]: DEBUG nova.service [None req-0ba6b920-3718-4292-944e-814c61bc82fd None None] Join ServiceGroup membership for this service conductor {{(pid=80830) start /opt/stack/nova/nova/service.py:199}} Apr 30 04:09:07.829018 n-d-763928-2 nova-conductor[80831]: DEBUG nova.servicegroup.drivers.db [None req-c73a39f7-5a2f-48c2-aee3-1491e0546e61 None None] DB_Driver: join new ServiceGroup member n-d-763928-2 to the conductor group, service = {{(pid=80831) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Apr 30 04:09:07.829324 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] conductor.workers = 2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.829424 n-d-763928-2 nova-conductor[80830]: DEBUG nova.servicegroup.drivers.db [None req-0ba6b920-3718-4292-944e-814c61bc82fd None None] DB_Driver: join new ServiceGroup member n-d-763928-2 to the conductor group, service = {{(pid=80830) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Apr 30 04:09:07.831090 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] console.allowed_origins = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.831718 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] console.ssl_ciphers = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.832354 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] console.ssl_minimum_version = default {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.832605 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] consoleauth.token_ttl = 600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.833113 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.833524 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.833924 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.834510 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.connect_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.835037 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.connect_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.835552 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.endpoint_override = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.835938 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.836420 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.836907 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.max_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.837282 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.min_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.837656 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.region_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.838046 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.service_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.838467 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.service_type = accelerator {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.838846 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.839222 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.status_code_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.839591 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.status_code_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.839965 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.840420 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.840791 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] cyborg.version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.841202 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.connection = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.841604 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.connection_debug = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.841993 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.connection_parameters = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.842380 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.connection_recycle_time = 3600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.842758 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.connection_trace = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.843142 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.max_overflow = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.843491 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.max_pool_size = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.843866 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.max_retries = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.844248 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.844653 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.pool_timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.845029 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.retry_interval = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.845764 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.slave_connection = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.846142 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] api_database.sqlite_synchronous = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.846523 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] devices.enabled_vgpu_types = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.847024 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.847396 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ephemeral_storage_encryption.enabled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.847767 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.848171 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.api_servers = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.848579 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.848998 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.849375 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.849765 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.connect_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.850136 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.connect_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.850517 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.debug = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.850889 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.default_trusted_certificate_ids = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.851256 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.enable_certificate_validation = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.851626 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.enable_rbd_download = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.851992 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.endpoint_override = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.852391 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.852791 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.853130 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.max_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.853497 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.min_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.853872 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.num_retries = 3 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.854253 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.rbd_ceph_conf = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.854627 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.rbd_connect_timeout = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.855013 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.rbd_pool = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.855515 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.rbd_user = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.855899 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.region_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.856270 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.service_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.856673 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.service_type = image {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.857141 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.857516 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.status_code_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.858041 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.status_code_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.858409 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.858807 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.859186 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.verify_glance_signatures = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.859547 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] glance.version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.859953 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] guestfs.debug = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.860442 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.config_drive_cdrom = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.860830 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.config_drive_inject_password = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.861200 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.861565 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.enable_instance_metrics_collection = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.861936 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.enable_remotefx = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.862320 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.instances_path_share = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.862692 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.iscsi_initiator_list = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.863069 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.limit_cpu_features = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.863443 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.863817 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.864187 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.power_state_check_timeframe = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.865117 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.865606 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.866016 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.use_multipath_io = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.866354 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.volume_attach_retry_count = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.866724 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.867197 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.vswitch_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.867591 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.867989 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] mks.enabled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.869039 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.869435 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] image_cache.manager_interval = 2400 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.869840 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] image_cache.precache_concurrency = 1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.870218 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] image_cache.remove_unused_base_images = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.870605 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.870987 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.871385 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] image_cache.subdirectory_name = _base {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.871799 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.api_max_retries = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.872174 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.api_retry_interval = 2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.872638 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.auth_section = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.873027 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.auth_type = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.873396 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.873763 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.874135 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.874501 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.connect_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.874873 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.connect_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.875241 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.endpoint_override = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.875726 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.876155 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.876491 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.max_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.876860 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.min_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.877330 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.partition_key = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.877707 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.peer_list = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.878077 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.region_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.878449 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.serial_console_state_timeout = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.878815 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.service_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.879197 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.service_type = baremetal {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.879567 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.879932 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.status_code_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.880968 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.status_code_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.881467 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.881881 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.882250 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ironic.version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.882659 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.883079 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] key_manager.fixed_key = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.883538 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.883916 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.barbican_api_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.884287 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.barbican_endpoint = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.884717 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.barbican_endpoint_type = public {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.885106 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.885473 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.885943 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.886306 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.886854 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.891825 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.number_of_retries = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.892706 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.retry_delay = 1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.893112 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.893509 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.893898 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.verify_ssl = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.894302 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] barbican.verify_ssl_path = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.894720 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.approle_role_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.895094 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.approle_secret_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.895511 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.895982 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.896478 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.896756 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.897125 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.897624 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.kv_mountpoint = secret {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.898007 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.kv_version = 2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.898378 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.root_token_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.898752 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.899126 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.ssl_ca_crt_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.899495 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.899890 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.use_ssl = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.900302 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.900738 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.901108 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.901484 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.901880 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.connect_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.902252 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.connect_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.902621 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.endpoint_override = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.902993 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.903360 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.903728 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.max_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.904094 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.min_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.904486 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.region_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.904856 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.service_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.905472 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.service_type = identity {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.905965 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.906341 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.status_code_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.906712 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.status_code_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.907083 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.907488 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.907861 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] keystone.version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.908352 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.connection_uri = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.908748 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.cpu_mode = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.909161 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.cpu_model_extra_flags = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.909588 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.cpu_models = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.909980 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.device_detach_attempts = 8 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.910377 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.device_detach_timeout = 20 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.910759 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.disk_cachemodes = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.911145 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.disk_prefix = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.911693 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.enabled_perf_events = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.912086 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.file_backed_memory = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.912492 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.gid_maps = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.912863 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.hw_disk_discard = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.913226 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.hw_machine_type = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.913609 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.images_rbd_ceph_conf = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.913984 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.914393 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.914778 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.images_rbd_glance_store_name = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.915164 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.images_rbd_pool = rbd {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.915572 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.images_type = default {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.915969 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.images_volume_group = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.916360 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.inject_key = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.916805 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.inject_partition = -2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.917106 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.inject_password = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.917509 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.iscsi_iface = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.917897 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.iser_use_multipath = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.918251 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.918624 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.919001 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_downtime = 500 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.919379 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.919744 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.920126 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_inbound_addr = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.920517 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.920890 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.921255 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_scheme = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.921653 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_timeout_action = abort {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.922024 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_tunnelled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.922405 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_uri = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.922777 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.live_migration_with_native_tls = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.923143 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.max_queues = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.923533 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.923918 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.nfs_mount_options = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.924485 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.924864 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.925241 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.num_iser_scan_tries = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.925666 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.926002 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.926370 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.num_pcie_ports = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.926755 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.num_volume_scan_tries = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.927698 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.pmem_namespaces = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.928120 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.quobyte_client_cfg = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.928615 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.929052 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rbd_connect_timeout = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.929429 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.929798 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.930293 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rbd_secret_uuid = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.930568 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rbd_user = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.930940 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.931333 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.931729 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rescue_image_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.932096 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rescue_kernel_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.932490 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rescue_ramdisk_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.932876 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.933264 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.rx_queue_size = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.933647 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.smbfs_mount_options = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.934119 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.934496 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.snapshot_compression = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.934861 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.snapshot_image_format = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.935327 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.935696 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.sparse_logical_volumes = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.936113 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.swtpm_enabled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.936482 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.swtpm_group = tss {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.936865 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.swtpm_user = tss {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.937258 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.sysinfo_serial = unique {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.937709 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.tx_queue_size = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.938085 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.uid_maps = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.938460 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.use_virtio_for_bridges = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.939543 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.virt_type = kvm {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.939543 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.volume_clear = zero {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.939894 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.volume_clear_size = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.940051 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.volume_use_multipath = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.940306 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.vzstorage_cache_path = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.940717 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.941174 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.vzstorage_mount_group = qemu {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.941462 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.vzstorage_mount_opts = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.941842 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.942404 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.942779 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.vzstorage_mount_user = stack {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.943650 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.944068 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.auth_section = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.944481 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.auth_type = password {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.944851 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.945215 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.945586 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.945951 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.connect_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.946582 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.connect_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.946819 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.default_floating_pool = public {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.947361 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.endpoint_override = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.947557 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.extension_sync_interval = 600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.947928 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.http_retries = 3 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.948309 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.949329 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.949329 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.max_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.949747 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.949900 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.min_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.950162 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.ovs_bridge = br-int {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.950542 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.physnets = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.950929 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.region_name = RegionOne {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.951313 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.service_metadata_proxy = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.951677 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.service_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.952065 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.service_type = network {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.952532 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.952906 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.status_code_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.953271 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.status_code_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.953667 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.954038 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.954403 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] neutron.version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.954784 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] notifications.bdms_in_notifications = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.955180 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] notifications.default_level = INFO {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.955573 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] notifications.notification_format = unversioned {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.955943 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] notifications.notify_on_state_change = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.956356 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.956744 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] pci.alias = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.957118 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] pci.passthrough_whitelist = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.957537 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.auth_section = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.958014 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.auth_type = password {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.958446 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.auth_url = http://10.222.0.18/identity {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.958819 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.959183 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.959551 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.959925 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.connect_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.960286 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.connect_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.960692 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.default_domain_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.961055 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.default_domain_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.961421 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.domain_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.961782 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.domain_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.962143 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.endpoint_override = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.962508 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.962873 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.963234 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.max_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.963594 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.min_version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.963977 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.password = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.964375 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.project_domain_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.964753 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.project_domain_name = Default {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.965129 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.project_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.965512 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.project_name = service {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.965897 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.region_name = RegionOne {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.966261 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.service_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.966647 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.service_type = placement {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.967014 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.967380 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.status_code_retries = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.967745 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.status_code_retry_delay = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.968108 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.system_scope = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.968506 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.968941 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.trust_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.969252 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.user_domain_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.969638 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.user_domain_name = Default {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.970006 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.user_id = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.970656 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.username = placement {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.971057 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.971499 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] placement.version = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.971932 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] powervm.disk_driver = localdisk {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.972425 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] powervm.proc_units_factor = 0.1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.972878 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] powervm.volume_group_name = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.973335 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.cores = 20 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.973773 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.count_usage_from_placement = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.974255 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.974724 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.injected_file_content_bytes = 10240 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.975175 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.injected_file_path_length = 255 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.975649 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.injected_files = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.976090 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.instances = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.976622 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.key_pairs = 100 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.977004 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.metadata_items = 128 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.977444 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.ram = 51200 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.977880 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.recheck_quota = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.978323 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.server_group_members = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.978767 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] quota.server_groups = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.979212 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] rdp.enabled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.980027 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.980458 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.980905 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.981347 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.image_metadata_prefilter = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.981792 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.982235 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.max_attempts = 3 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.982674 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.max_placement_results = 1000 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.983111 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.983547 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.query_placement_for_availability_zone = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.983983 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.984438 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.984893 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] scheduler.workers = 2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.985368 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.985822 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.986324 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.986783 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.987225 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.987680 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.988117 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.988631 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.989084 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.host_subset_size = 1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.990117 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.990486 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.990932 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.isolated_hosts = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.991438 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.isolated_images = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.991866 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.992263 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.992684 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.993170 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.993551 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.993922 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.994297 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.994671 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.995058 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.track_instance_changes = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.995454 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.995844 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] metrics.required = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.996224 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] metrics.weight_multiplier = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.996620 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.996995 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] metrics.weight_setting = [] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.997570 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.997996 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] serial_console.enabled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.998357 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] serial_console.port_range = 10000:20000 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.998756 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.999156 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.999539 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] serial_console.serialproxy_port = 6083 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:07.999918 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.auth_section = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.000303 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.auth_type = password {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.000702 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.001071 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.001444 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.001822 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.002190 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.002577 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.send_service_user_token = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.002947 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.003313 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] service_user.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.003710 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] spice.agent_enabled = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.004077 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] spice.enabled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.004711 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.005211 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.006104 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] spice.html5proxy_port = 6082 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.006491 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] spice.server_listen = 127.0.0.1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.006881 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.007289 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] upgrade_levels.baseapi = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.007644 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] upgrade_levels.cert = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.008102 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] upgrade_levels.compute = auto {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.008416 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] upgrade_levels.conductor = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.008777 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] upgrade_levels.scheduler = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.009178 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.009555 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.009914 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vendordata_dynamic_auth.cafile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.010538 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vendordata_dynamic_auth.certfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.010921 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.011289 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vendordata_dynamic_auth.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.011652 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.012014 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.012405 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vendordata_dynamic_auth.timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.012832 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.api_retry_count = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.013198 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.ca_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.013596 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.cache_prefix = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.013961 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.cluster_name = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.014348 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.connection_pool_size = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.014716 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.console_delay_seconds = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.015084 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.datastore_regex = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.015449 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.host_ip = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.015810 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.host_password = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.016178 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.host_port = 443 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.016558 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.host_username = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.016958 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.insecure = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.017397 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.integration_bridge = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.017696 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.maximum_objects = 100 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.018061 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.pbm_default_policy = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.018429 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.pbm_enabled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.018800 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.pbm_wsdl_location = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.019185 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.019554 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.serial_port_proxy_uri = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.019916 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.serial_port_service_uri = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.020301 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.task_poll_interval = 0.5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.020696 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.use_linked_clone = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.021107 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.vnc_keymap = en-us {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.021497 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.vnc_port = 5900 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.021868 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vmware.vnc_port_total = 10000 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.022295 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.auth_schemes = ['none'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.022669 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.enabled = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.023265 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.023661 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.024041 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.novncproxy_port = 6080 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.024547 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.server_listen = 127.0.0.1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.024947 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.025458 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.vencrypt_ca_certs = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.025673 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.vencrypt_client_cert = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.026036 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] vnc.vencrypt_client_key = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.026454 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.026834 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.027209 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.027580 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.disable_native_luksv1 = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.027949 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.disable_rootwrap = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.028361 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.enable_numa_live_migration = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.028746 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.029065 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.029446 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.029824 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.rbd_volume_local_attach = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.030177 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.030599 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.031013 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.client_socket_timeout = 900 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.031392 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.default_pool_size = 1000 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.031767 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.keep_alive = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.032234 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.max_header_line = 16384 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.032562 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.secure_proxy_ssl_header = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.032933 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.ssl_ca_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.033304 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.ssl_cert_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.033674 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.ssl_key_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.034049 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.tcp_keepidle = 600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.034452 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.034856 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] zvm.ca_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.035224 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] zvm.cloud_connector_url = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.035701 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.036076 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] zvm.reachable_timeout = 300 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.036558 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.enforce_new_defaults = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.037003 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.enforce_scope = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.037488 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.policy_default_rule = default {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.037848 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.038246 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.policy_file = policy.yaml {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.038679 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.039052 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.039426 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.039792 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.040178 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.040607 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.041045 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.connection_string = messaging:// {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.041446 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.enabled = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.041848 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.es_doc_type = notification {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.042241 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.es_scroll_size = 10000 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.042628 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.es_scroll_time = 2m {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.043002 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.filter_error_trace = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.043437 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.hmac_keys = SECRET_KEY {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.043759 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.sentinel_service_name = mymaster {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.044164 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.socket_timeout = 0.1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.044559 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] profiler.trace_sqlalchemy = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.044976 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.backend = sqlalchemy {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.045375 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.connection = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.045758 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.connection_debug = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.046143 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.connection_parameters = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.046532 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.connection_recycle_time = 3600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.046902 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.connection_trace = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.047268 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.db_inc_retry_interval = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.047640 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.db_max_retries = 20 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.048006 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.db_max_retry_interval = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.048395 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.db_retry_interval = 1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.048797 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.max_overflow = 50 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.049176 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.max_pool_size = 5 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.049548 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.max_retries = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.049915 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.mysql_enable_ndb = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.050295 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.050712 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.pool_timeout = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.051097 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.retry_interval = 10 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.051609 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.slave_connection = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.052749 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.sqlite_synchronous = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.053017 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.use_db_reconnect = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.053241 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] database.use_tpool = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.053651 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] remote_debug.host = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.054020 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] remote_debug.port = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.054456 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.054835 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.055222 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.055592 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.055967 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.056355 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.056740 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.057131 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.057517 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.057920 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.058269 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.058650 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.059042 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.059415 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.059786 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.060181 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.060581 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.060958 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.061329 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.061709 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.062082 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.062467 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.ssl = False {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.062876 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.063279 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.063670 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.064086 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.064557 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.064943 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_notifications.retry = -1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.065354 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.065761 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.066168 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_reports.file_event_handler = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.066543 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.066923 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] oslo_reports.log_dir = None {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 04:09:08.067233 n-d-763928-2 nova-conductor[79963]: DEBUG oslo_service.service [None req-eb4a0336-7de4-4cc1-a646-911cdaa3aeb5 None None] ******************************************************************************** {{(pid=79963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 04:12:07.801282 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:12:07.815846 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:12:08.822534 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55990. Apr 30 04:12:08.837108 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55992. Apr 30 04:15:08.820511 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:15:08.834978 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:15:09.842107 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56056. Apr 30 04:15:09.855591 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56058. Apr 30 04:17:54.970241 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_db.sqlalchemy.engines [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Parent process 79963 forked (80831) with an open database connection, which is being discarded and recreated. {{(pid=80831) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Apr 30 04:17:56.188864 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Took 1.20 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:17:56.329237 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:17:56.340106 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:17:56.371820 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_db.sqlalchemy.engines [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 04:17:56.605577 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:17:56.611048 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:17:56.613002 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:17:56.614531 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:17:56.663537 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_db.sqlalchemy.engines [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 04:17:56.709360 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Getting quotas for project 354f21cb00004f6fac719adb762f0295. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:17:56.717476 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Getting quotas for user 950dc40455b344d98c368c277e8e5a2b and project 354f21cb00004f6fac719adb762f0295. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:17:56.730142 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] [instance: 8bc87a65-10fd-4ded-a2ba-ba4b6e795075] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:17:56.731407 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:17:56.732017 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:17:56.763112 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] [instance: 8bc87a65-10fd-4ded-a2ba-ba4b6e795075] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:17:56.766708 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:17:56.767941 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:17:56.847579 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:17:56.848254 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:17:56.848999 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc0bac33-edb7-4217-85de-aef54bd57018 tempest-AggregatesAdminTestJSON-60085930 tempest-AggregatesAdminTestJSON-60085930-project] Acquired lock "compute-rpcapi-router" {{(pid=80831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 30 04:17:56.852288 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54569537-c5d1-4342-9d26-649ad026b0f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:17:56.852877 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54569537-c5d1-4342-9d26-649ad026b0f6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:17:56.853609 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54569537-c5d1-4342-9d26-649ad026b0f6 None None] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:17:56.854071 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54569537-c5d1-4342-9d26-649ad026b0f6 None None] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:17:56.865424 n-d-763928-2 nova-conductor[80831]: INFO nova.compute.rpcapi [None req-54569537-c5d1-4342-9d26-649ad026b0f6 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 30 04:17:56.866493 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54569537-c5d1-4342-9d26-649ad026b0f6 None None] Releasing lock "compute-rpcapi-router" {{(pid=80831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 30 04:18:04.548718 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_db.sqlalchemy.engines [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Parent process 79963 forked (80830) with an open database connection, which is being discarded and recreated. {{(pid=80830) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Apr 30 04:18:05.757871 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Took 1.12 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:18:05.840126 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:05.860599 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:05.885418 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_db.sqlalchemy.engines [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 04:18:06.082940 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:06.096366 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:06.096366 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:06.096366 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:06.156900 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_db.sqlalchemy.engines [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 04:18:06.226192 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Getting quotas for project 713fd95bbd9d41b293beddc11b7b1f60. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:18:06.249569 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Getting quotas for user 221f0b7a866d4da39fab41e46258d3ea and project 713fd95bbd9d41b293beddc11b7b1f60. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:18:06.270618 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] [instance: 17a33218-9192-4876-a72a-505da93d34d0] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:18:06.271976 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:06.274025 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:06.299664 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] [instance: 17a33218-9192-4876-a72a-505da93d34d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:18:06.302682 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:06.305476 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:06.473043 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:06.473043 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:06.473853 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2d50e2d-5b3a-47f5-83a9-c9284dd72a43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Acquired lock "compute-rpcapi-router" {{(pid=80830) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 30 04:18:06.474518 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-de8f68f1-bd3d-4e21-85f9-6e69b54f0ab5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:06.475004 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-de8f68f1-bd3d-4e21-85f9-6e69b54f0ab5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:06.475992 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-de8f68f1-bd3d-4e21-85f9-6e69b54f0ab5 None None] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:06.478086 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-de8f68f1-bd3d-4e21-85f9-6e69b54f0ab5 None None] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:06.518503 n-d-763928-2 nova-conductor[80830]: INFO nova.compute.rpcapi [None req-de8f68f1-bd3d-4e21-85f9-6e69b54f0ab5 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 30 04:18:06.519690 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-de8f68f1-bd3d-4e21-85f9-6e69b54f0ab5 None None] Releasing lock "compute-rpcapi-router" {{(pid=80830) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 30 04:18:06.969801 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:18:07.050195 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:07.050986 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:07.155462 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:07.156234 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:07.157509 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:07.158588 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:07.236514 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Getting quotas for project 713fd95bbd9d41b293beddc11b7b1f60. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:18:07.241231 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Getting quotas for user 221f0b7a866d4da39fab41e46258d3ea and project 713fd95bbd9d41b293beddc11b7b1f60. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:18:07.255135 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] [instance: 2954aac1-6e47-4042-86ae-b5982c1c578e] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:18:07.256635 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:07.257360 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:07.280291 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] [instance: 2954aac1-6e47-4042-86ae-b5982c1c578e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:18:07.281655 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:07.282709 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:07.356768 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:07.357184 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-05be25e1-c18f-472e-9dfb-6c96d8bacd43 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:24.793364 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:18:24.819026 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:24.819436 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:24.908612 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:24.909025 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:24.909753 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:24.910148 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:24.927257 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Getting quotas for project 8b5a20031d2e41e8867f7c560d079062. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:18:24.931236 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Getting quotas for user 74443d1b1a4b4897bb3882ccb700ef1c and project 8b5a20031d2e41e8867f7c560d079062. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:18:24.942078 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] [instance: cde380b4-0f93-493a-b974-4c51fb8f55d6] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:18:24.943209 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:24.943761 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:24.956348 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] [instance: cde380b4-0f93-493a-b974-4c51fb8f55d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:18:24.958062 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:24.958654 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:25.027815 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:25.027980 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b25021c-8f79-413f-b85d-f9cfc840c06c tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:36.891005 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:18:36.928645 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:36.929125 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:36.994801 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:36.995471 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:36.996711 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:36.997271 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:37.017634 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Getting quotas for project 713fd95bbd9d41b293beddc11b7b1f60. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:18:37.022751 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Getting quotas for user 221f0b7a866d4da39fab41e46258d3ea and project 713fd95bbd9d41b293beddc11b7b1f60. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:18:37.037509 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] [instance: bf4376fa-9405-48be-946b-123f5253ce69] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:18:37.039188 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:37.039661 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:37.049422 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] [instance: bf4376fa-9405-48be-946b-123f5253ce69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:18:37.051385 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:37.051901 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:37.092234 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:37.092963 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-af7bdf76-65b1-4823-a725-f8b228d08fa4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:37.646677 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:18:37.682170 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:37.682603 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:37.751661 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:37.751888 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:37.752760 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:37.753299 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:37.769809 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Getting quotas for project 132ef51adad94b8cac8e6519cd1cde1f. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:18:37.774886 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Getting quotas for user 48ba770f2e074fbdadade9abace178e0 and project 132ef51adad94b8cac8e6519cd1cde1f. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:18:37.792416 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] [instance: 5bdbeedf-9e79-4cc4-b122-839804f2c3e9] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:18:37.793375 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:37.793794 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:37.804991 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] [instance: 5bdbeedf-9e79-4cc4-b122-839804f2c3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:18:37.806522 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:37.807080 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:37.868334 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:37.868752 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f8ae37c8-9948-4b59-b7c3-406bf66d2405 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:55.538983 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:18:55.586159 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:55.587076 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:55.702707 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:55.704405 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:55.705798 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:55.707988 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:55.734851 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Getting quotas for project 3b54194079ba4c2ba2a30b6dd2e07b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:18:55.740176 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Getting quotas for user a445ca53cc8e4150ac1c6e92db611dcf and project 3b54194079ba4c2ba2a30b6dd2e07b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:18:55.752867 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] [instance: e2ee2474-da5d-4b33-8ff6-7c453b1cd7d5] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:18:55.754324 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:55.754925 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:55.767944 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] [instance: e2ee2474-da5d-4b33-8ff6-7c453b1cd7d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:18:55.769823 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:55.770475 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:55.828936 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:55.829657 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b63baec1-532a-461c-85ef-94119c926307 tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:57.114895 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:18:57.164002 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:57.164441 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:57.255305 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:57.255901 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:57.256822 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:57.257886 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:57.295094 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Getting quotas for project 02b2e2471da64170aff0e16c8b1ca7dd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:18:57.303226 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Getting quotas for user 6dca419ffe1c4cd98b27fd902edab2cb and project 02b2e2471da64170aff0e16c8b1ca7dd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:18:57.329798 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] [instance: 1dbbfaa5-4c08-4b26-93f0-9a26ee936fae] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:18:57.331299 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:57.331880 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:57.342739 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] [instance: 1dbbfaa5-4c08-4b26-93f0-9a26ee936fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:18:57.345950 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:57.346611 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:18:57.394578 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:18:57.395277 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-db72181b-de49-4474-af36-27d908bfb271 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:10.703850 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:19:10.747419 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:10.751694 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:10.832954 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:10.833565 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:10.834872 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:10.835527 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:10.872679 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Getting quotas for project 132ef51adad94b8cac8e6519cd1cde1f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:19:10.884087 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Getting quotas for user 48ba770f2e074fbdadade9abace178e0 and project 132ef51adad94b8cac8e6519cd1cde1f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:19:10.913661 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] [instance: d4a4ef47-fa93-4e4f-8c7d-a210d97f09b8] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:19:10.914827 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:10.916558 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:10.934710 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] [instance: d4a4ef47-fa93-4e4f-8c7d-a210d97f09b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:19:10.937919 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:10.938937 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:10.998816 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:11.000793 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9940fd09-fe71-45a8-8d41-5cc1107409e5 tempest-DeleteServersAdminTestJSON-982548501 tempest-DeleteServersAdminTestJSON-982548501-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:12.306685 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-11800404-63d8-40de-b008-5c7a063104f4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method rebuild_instance {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:19:12.307354 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-11800404-63d8-40de-b008-5c7a063104f4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:12.307756 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-11800404-63d8-40de-b008-5c7a063104f4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:12.355041 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-11800404-63d8-40de-b008-5c7a063104f4 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] [instance: 17a33218-9192-4876-a72a-505da93d34d0] No migration record for the rebuild/evacuate request. {{(pid=80830) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 30 04:19:22.390824 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:19:22.418177 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:22.418904 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:22.496055 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:22.496762 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:22.497653 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:22.498227 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:22.517303 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Getting quotas for project d989bba102ce4824b98c613db6a5afab. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:19:22.525089 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Getting quotas for user 77dbec27f30d4f08b6becad7030cb6e6 and project d989bba102ce4824b98c613db6a5afab. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:19:22.538753 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: f7500efc-6e48-456d-86d0-04f1a663a6af] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:19:22.539918 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:22.540496 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:22.553114 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: f7500efc-6e48-456d-86d0-04f1a663a6af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:19:22.555309 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:22.556054 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:22.618541 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:22.619001 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd47-cb8f-40a3-879f-da56616f6bb7 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:23.205956 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-90e02d0d-372c-465e-a834-67e1cee30707 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:19:23.207123 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-90e02d0d-372c-465e-a834-67e1cee30707 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:23.207746 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-90e02d0d-372c-465e-a834-67e1cee30707 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:23.984919 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-90e02d0d-372c-465e-a834-67e1cee30707 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Created allocations for migration 96f1a6b6-e170-4613-9d45-10a22db84d31 on 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:19:24.166111 n-d-763928-2 nova-conductor[80830]: DEBUG nova.scheduler.utils [None req-90e02d0d-372c-465e-a834-67e1cee30707 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] [instance: 1dbbfaa5-4c08-4b26-93f0-9a26ee936fae] Instance allocations successfully created on destination node 9af7e94c-c36e-4570-becd-82af4f5fb2a0: {'allocations': {'9af7e94c-c36e-4570-becd-82af4f5fb2a0': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=80830) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 30 04:19:24.167114 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-90e02d0d-372c-465e-a834-67e1cee30707 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lazy-loading 'resources' on Instance uuid 1dbbfaa5-4c08-4b26-93f0-9a26ee936fae {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:19:24.182483 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-90e02d0d-372c-465e-a834-67e1cee30707 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lazy-loading 'pci_requests' on Instance uuid 1dbbfaa5-4c08-4b26-93f0-9a26ee936fae {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:19:24.882179 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.live_migrate [None req-90e02d0d-372c-465e-a834-67e1cee30707 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] [instance: 1dbbfaa5-4c08-4b26-93f0-9a26ee936fae] Start binding ports on destination host: n-h2-763928-2 {{(pid=80830) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 30 04:19:36.086603 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7fd53e6a-f24d-4aaf-a001-a42a98bb9e91 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method rebuild_instance {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:19:36.088941 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7fd53e6a-f24d-4aaf-a001-a42a98bb9e91 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:36.089994 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7fd53e6a-f24d-4aaf-a001-a42a98bb9e91 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:36.148813 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7fd53e6a-f24d-4aaf-a001-a42a98bb9e91 tempest-ServersAdminTestJSON-1386956346 tempest-ServersAdminTestJSON-1386956346-project] [instance: 17a33218-9192-4876-a72a-505da93d34d0] No migration record for the rebuild/evacuate request. {{(pid=80831) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 30 04:19:40.658153 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:19:40.713451 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:40.714882 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:40.799811 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:40.800355 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:40.803649 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:40.804383 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:40.825724 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Getting quotas for project 3b54194079ba4c2ba2a30b6dd2e07b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:19:40.834023 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Getting quotas for user a445ca53cc8e4150ac1c6e92db611dcf and project 3b54194079ba4c2ba2a30b6dd2e07b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:19:40.848759 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] [instance: 5b0ed51d-237f-4bca-b579-a7b6982c7d8e] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:19:40.849834 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:40.850357 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:40.867001 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] [instance: 5b0ed51d-237f-4bca-b579-a7b6982c7d8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:19:40.868273 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:40.871376 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:40.939698 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:40.940511 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39460b6b-5aef-49a0-a50d-fb93b708cf1f tempest-SecurityGroupsTestJSON-1012530798 tempest-SecurityGroupsTestJSON-1012530798-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:45.534995 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-03033105-5bd9-4242-9336-0f53438769a1 tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:19:45.535922 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-03033105-5bd9-4242-9336-0f53438769a1 tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:45.536353 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-03033105-5bd9-4242-9336-0f53438769a1 tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:46.524241 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-03033105-5bd9-4242-9336-0f53438769a1 tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] [instance: f7500efc-6e48-456d-86d0-04f1a663a6af] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 04:19:47.000581 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-03033105-5bd9-4242-9336-0f53438769a1 tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] Created allocations for migration 09ef7ced-99b9-4368-91b8-461a874b7160 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:19:47.427607 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-03033105-5bd9-4242-9336-0f53438769a1 tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] [instance: f7500efc-6e48-456d-86d0-04f1a663a6af] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 04:19:47.591908 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:19:47.663805 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:47.664236 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:47.805714 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:47.814092 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:47.815018 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:47.815419 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:47.867459 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Getting quotas for project 02b2e2471da64170aff0e16c8b1ca7dd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:19:47.872426 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Getting quotas for user 6dca419ffe1c4cd98b27fd902edab2cb and project 02b2e2471da64170aff0e16c8b1ca7dd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:19:47.899882 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] [instance: 65c008f4-fbaf-42a6-9dad-8d0e5fa8bbbe] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:19:47.901267 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:47.901847 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:47.912528 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] [instance: 65c008f4-fbaf-42a6-9dad-8d0e5fa8bbbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:19:47.914758 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:47.915436 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:47.963118 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:47.963628 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6bfe5ca7-6fc6-4b9b-8e53-66e4ddc04168 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:59.427210 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:19:59.456978 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:59.457661 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:59.533069 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:59.533480 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:59.534215 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:59.534613 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:59.578072 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Getting quotas for project 5553bc04f27f44069c1fac29e58bcdd7. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:19:59.587150 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Getting quotas for user abdaf714e464488b98263e3a62151144 and project 5553bc04f27f44069c1fac29e58bcdd7. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:19:59.600202 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] [instance: 6896835e-4d1e-4fd1-b1a0-6d339c4cc1cb] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:19:59.601623 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:59.602180 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:59.612179 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] [instance: 6896835e-4d1e-4fd1-b1a0-6d339c4cc1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:19:59.613626 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:59.614304 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:19:59.657701 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:19:59.658709 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30f7f156-fbcd-400f-9ea2-ee9cf415ba33 tempest-ServerDiagnosticsNegativeTest-894581246 tempest-ServerDiagnosticsNegativeTest-894581246-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:12.181912 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-01b30691-2c9b-4551-ad92-5be7507ee23d tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:20:12.183011 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-01b30691-2c9b-4551-ad92-5be7507ee23d tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:12.183673 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-01b30691-2c9b-4551-ad92-5be7507ee23d tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:12.537974 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-01b30691-2c9b-4551-ad92-5be7507ee23d tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Created allocations for migration 5bc7f776-e21e-4a1b-a400-3978fd3f2d95 on 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:20:12.656871 n-d-763928-2 nova-conductor[80830]: DEBUG nova.scheduler.utils [None req-01b30691-2c9b-4551-ad92-5be7507ee23d tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] [instance: 65c008f4-fbaf-42a6-9dad-8d0e5fa8bbbe] Instance allocations successfully created on destination node 9af7e94c-c36e-4570-becd-82af4f5fb2a0: {'allocations': {'9af7e94c-c36e-4570-becd-82af4f5fb2a0': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=80830) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 30 04:20:12.657321 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-01b30691-2c9b-4551-ad92-5be7507ee23d tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lazy-loading 'resources' on Instance uuid 65c008f4-fbaf-42a6-9dad-8d0e5fa8bbbe {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:20:12.664732 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-01b30691-2c9b-4551-ad92-5be7507ee23d tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lazy-loading 'pci_requests' on Instance uuid 65c008f4-fbaf-42a6-9dad-8d0e5fa8bbbe {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:20:13.001080 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.live_migrate [None req-01b30691-2c9b-4551-ad92-5be7507ee23d tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] [instance: 65c008f4-fbaf-42a6-9dad-8d0e5fa8bbbe] Start binding ports on destination host: n-h2-763928-2 {{(pid=80830) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 30 04:20:26.707705 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:20:26.808431 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:26.809119 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:26.950410 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:26.951158 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:26.952108 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:26.952551 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.004548 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Getting quotas for project 8b5a20031d2e41e8867f7c560d079062. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:20:27.020591 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Getting quotas for user 74443d1b1a4b4897bb3882ccb700ef1c and project 8b5a20031d2e41e8867f7c560d079062. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:20:27.044692 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] [instance: 95aa0308-02f7-4298-b9cf-f6edbbaf90a1] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:20:27.045991 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.046583 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.057731 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] [instance: 95aa0308-02f7-4298-b9cf-f6edbbaf90a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:20:27.062204 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.063566 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.087736 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.088070 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.206008 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.208970 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f12f1639-c80d-4a4c-b225-15887d585730 tempest-ServersWithSpecificFlavorTestJSON-1721173529 tempest-ServersWithSpecificFlavorTestJSON-1721173529-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.480348 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:20:27.549798 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.550216 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.664238 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.665172 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.667940 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.668461 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.705458 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Getting quotas for project d989bba102ce4824b98c613db6a5afab. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:20:27.720214 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Getting quotas for user 77dbec27f30d4f08b6becad7030cb6e6 and project d989bba102ce4824b98c613db6a5afab. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:20:27.748625 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: b68f5dab-867f-4584-9840-612015411ebf] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:20:27.750226 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.752959 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.763325 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: b68f5dab-867f-4584-9840-612015411ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:20:27.766454 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.768161 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:27.822962 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:27.823377 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-5f5b380f-99f7-40df-9e55-c00052e50285 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:29.518885 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:20:29.564217 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:29.568674 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:29.660532 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:29.661103 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:29.661638 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:29.662051 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:29.703533 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Getting quotas for project f8d66cf6560e4eb88623cb02fc50a3ea. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:20:29.713866 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Getting quotas for user 32d18f2d08724525836c07edf00c1cf0 and project f8d66cf6560e4eb88623cb02fc50a3ea. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:20:29.733972 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] [instance: 49ababdb-cda6-45d6-bab7-c3335f3b1fa6] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:20:29.736008 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:29.736663 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:29.745712 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] [instance: 49ababdb-cda6-45d6-bab7-c3335f3b1fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:20:29.747174 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:29.748510 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:29.810081 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:29.811289 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7de5dff9-c105-4d0c-a28f-0048916dc2ae tempest-TenantUsagesTestJSON-1235918043 tempest-TenantUsagesTestJSON-1235918043-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:38.230263 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:20:38.261426 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:38.262164 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:38.327676 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:38.328356 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:38.329284 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:38.329875 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:38.351110 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Getting quotas for project 02b2e2471da64170aff0e16c8b1ca7dd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:20:38.358988 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Getting quotas for user 6dca419ffe1c4cd98b27fd902edab2cb and project 02b2e2471da64170aff0e16c8b1ca7dd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:20:38.372034 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] [instance: 60653a1a-eb87-4775-8a11-4f0488641111] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:20:38.373059 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:38.373491 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:38.386123 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] [instance: 60653a1a-eb87-4775-8a11-4f0488641111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:20:38.398180 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:38.398679 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:38.452741 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:38.453279 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc759adf-063b-4bd4-9dc4-71e5c8713ea1 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:52.009752 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:20:52.061666 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:52.062102 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:52.183775 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:52.184247 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:52.188022 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:52.188836 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:52.230368 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Getting quotas for project f21df4156dd94a69bd6e7a9bbae17637. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:20:52.241955 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Getting quotas for user 05ea435a0b624010b7806dbebcd67843 and project f21df4156dd94a69bd6e7a9bbae17637. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:20:52.274778 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] [instance: 0fe76ffd-89c7-4d99-880c-07d315991524] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:20:52.276696 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:52.278531 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:52.291026 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] [instance: 0fe76ffd-89c7-4d99-880c-07d315991524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:20:52.292861 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:52.293264 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:52.357470 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:52.357976 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a0b4e8a-5c72-4c3c-9bd9-8c06cb49872e tempest-ServersTestJSON-854423573 tempest-ServersTestJSON-854423573-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:56.977789 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-3fe487b8-6a72-45de-ace1-67c587207899 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:20:56.996636 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3fe487b8-6a72-45de-ace1-67c587207899 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:56.997393 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3fe487b8-6a72-45de-ace1-67c587207899 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:57.282958 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-3fe487b8-6a72-45de-ace1-67c587207899 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: b68f5dab-867f-4584-9840-612015411ebf] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80830) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 04:20:58.072152 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-3fe487b8-6a72-45de-ace1-67c587207899 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Created allocations for migration 0542a7e9-8a90-4026-88dc-91ffd5c06a4d on 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:20:58.498018 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-3fe487b8-6a72-45de-ace1-67c587207899 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: b68f5dab-867f-4584-9840-612015411ebf] Calling prep_resize with selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"1508a0ee-85c8-42eb-a6ba-5ec68c136fa8": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1508a0ee-85c8-42eb-a6ba-5ec68c136fa8"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=1508a0ee-85c8-42eb-a6ba-5ec68c136fa8,limits=SchedulerLimits,nodename='n-h1-763928-2',service_host='n-h1-763928-2')] {{(pid=80830) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 04:20:59.820023 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:20:59.863478 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:59.863783 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:59.926174 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:59.926624 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:59.927383 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:59.927973 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:59.946707 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Getting quotas for project 92ea34fce5f34477869bc0b59378b315. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:20:59.953363 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Getting quotas for user 282d1f35bff84705a5cfd9a56ce9113f and project 92ea34fce5f34477869bc0b59378b315. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:20:59.968355 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] [instance: fe08394e-46d2-4031-8ea0-4efd80d58765] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:20:59.969737 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:59.970403 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:20:59.977830 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] [instance: fe08394e-46d2-4031-8ea0-4efd80d58765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:20:59.979640 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:20:59.980386 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:00.019122 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:00.019538 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-194f1397-1d8d-4bf2-80f5-9a38861153fa tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:05.830039 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:21:05.913160 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:05.914942 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:06.000414 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:06.002450 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:06.003378 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:06.004346 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:06.044835 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Getting quotas for project 92ea34fce5f34477869bc0b59378b315. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:21:06.053433 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Getting quotas for user 282d1f35bff84705a5cfd9a56ce9113f and project 92ea34fce5f34477869bc0b59378b315. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:21:06.082843 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] [instance: ed7ddcf1-5c09-4d22-a806-49b3c0f2f219] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:21:06.083737 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:06.084333 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:06.098226 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] [instance: ed7ddcf1-5c09-4d22-a806-49b3c0f2f219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:21:06.100123 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:06.100715 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:06.156140 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:06.156760 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-490977d2-4fe1-4005-8c41-505f9fbdd403 tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:10.661444 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:21:10.717502 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:10.717904 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:10.813552 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:10.815555 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:10.817653 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:10.819887 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:10.860955 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Getting quotas for project 92ea34fce5f34477869bc0b59378b315. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:21:10.867491 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Getting quotas for user 282d1f35bff84705a5cfd9a56ce9113f and project 92ea34fce5f34477869bc0b59378b315. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:21:10.883596 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] [instance: fab62fb3-7d25-482e-b278-1f97a18b78dd] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:21:10.885091 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:10.885819 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:10.894638 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] [instance: fab62fb3-7d25-482e-b278-1f97a18b78dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:21:10.897347 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:10.898387 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:10.943687 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:10.944733 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-870d8c51-0b9c-4894-af66-c77cb2645d5f tempest-ListServerFiltersTestJSON-449390461 tempest-ListServerFiltersTestJSON-449390461-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:30.803192 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:21:30.852769 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:30.854716 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:30.967025 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:30.968898 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:30.969882 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:30.970884 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:31.032568 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Getting quotas for project 32cb415ee3b24601ade5ee008b28c816. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:21:31.055037 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Getting quotas for user c9656df87366462ea1fe14f31c8d3903 and project 32cb415ee3b24601ade5ee008b28c816. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:21:31.101766 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] [instance: 12b9926e-276e-4e7b-a344-76d3033f49a3] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:21:31.104843 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:31.109817 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:31.134320 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] [instance: 12b9926e-276e-4e7b-a344-76d3033f49a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:21:31.135715 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:31.137991 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:31.275011 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:31.291362 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b9030476-883c-41aa-867a-22dc94441c26 tempest-VolumesAdminNegativeTest-1074729940 tempest-VolumesAdminNegativeTest-1074729940-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:46.575745 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bddd1980-c143-4848-8356-f1dbe8d1901f tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:21:46.576413 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bddd1980-c143-4848-8356-f1dbe8d1901f tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:46.576732 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bddd1980-c143-4848-8356-f1dbe8d1901f tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:47.014063 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-bddd1980-c143-4848-8356-f1dbe8d1901f tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Created allocations for migration e2288092-4837-4422-92a8-ee857ba7ed51 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:21:47.128266 n-d-763928-2 nova-conductor[80831]: DEBUG nova.scheduler.utils [None req-bddd1980-c143-4848-8356-f1dbe8d1901f tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] [instance: 60653a1a-eb87-4775-8a11-4f0488641111] Instance allocations successfully created on destination node 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8: {'allocations': {'1508a0ee-85c8-42eb-a6ba-5ec68c136fa8': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=80831) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 30 04:21:47.128737 n-d-763928-2 nova-conductor[80831]: DEBUG nova.objects.instance [None req-bddd1980-c143-4848-8356-f1dbe8d1901f tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lazy-loading 'resources' on Instance uuid 60653a1a-eb87-4775-8a11-4f0488641111 {{(pid=80831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:21:47.134298 n-d-763928-2 nova-conductor[80831]: DEBUG nova.objects.instance [None req-bddd1980-c143-4848-8356-f1dbe8d1901f tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lazy-loading 'pci_requests' on Instance uuid 60653a1a-eb87-4775-8a11-4f0488641111 {{(pid=80831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:21:47.592145 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.live_migrate [None req-bddd1980-c143-4848-8356-f1dbe8d1901f tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] [instance: 60653a1a-eb87-4775-8a11-4f0488641111] Start binding ports on destination host: n-h1-763928-2 {{(pid=80831) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 30 04:21:50.327089 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:21:50.349568 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:50.350266 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:50.415563 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:50.415846 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:50.416504 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:50.416901 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:50.437092 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Getting quotas for project 04a53e40cd3b4398ae9d96f2678ecae8. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:21:50.442104 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Getting quotas for user 1fa53554d6c94249bd16f68d3796731e and project 04a53e40cd3b4398ae9d96f2678ecae8. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:21:50.453650 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] [instance: b3653bb7-07b7-4909-bcd6-a2ded8e62d1a] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:21:50.454616 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:50.455154 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:50.463378 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] [instance: b3653bb7-07b7-4909-bcd6-a2ded8e62d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4340af2d-2645-43f9-b0b7-38aefe659ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:21:50.464940 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:50.465712 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:50.501431 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:50.502224 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f9abfcb0-473f-4144-954a-9f10e1ff1df8 tempest-AttachSCSIVolumeTestJSON-1464906432 tempest-AttachSCSIVolumeTestJSON-1464906432-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:55.118083 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:21:55.150490 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:55.150910 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:55.255053 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:55.255719 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:55.267349 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:55.267770 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:55.285101 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Getting quotas for project d989bba102ce4824b98c613db6a5afab. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:21:55.291992 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Getting quotas for user 77dbec27f30d4f08b6becad7030cb6e6 and project d989bba102ce4824b98c613db6a5afab. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:21:55.306713 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: 906e664a-61eb-4e71-9cb9-b8ab0b0a5b64] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:21:55.308520 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:55.309700 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:55.320997 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: 906e664a-61eb-4e71-9cb9-b8ab0b0a5b64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:21:55.325278 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:55.327846 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:21:55.373273 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:21:55.374040 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6e38f55c-ec2b-4999-ad45-eee09b58599a tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:22:10.112647 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:22:10.136881 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:22:10.137446 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:22:10.194414 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:22:10.194826 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:22:10.195550 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:22:10.195946 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:22:10.212103 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Getting quotas for project 5c864c6f86ef4cc695fcf8dbf63b06b4. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:22:10.217278 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Getting quotas for user b7b279a7bb054590a1e31aa33bac6adb and project 5c864c6f86ef4cc695fcf8dbf63b06b4. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:22:10.227960 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] [instance: 158549f4-5ded-41f7-8dbe-6c1139629f84] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:22:10.229091 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:22:10.229497 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:22:10.236546 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] [instance: 158549f4-5ded-41f7-8dbe-6c1139629f84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:22:10.237774 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:22:10.238176 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:22:10.265958 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:22:10.266424 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-684a13c8-b68c-4b02-a353-209790bd2104 tempest-ImagesNegativeTestJSON-826931019 tempest-ImagesNegativeTestJSON-826931019-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:22:19.185274 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-734779aa-72d3-4185-874e-eb0c2f6ba0db tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:22:19.185839 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-734779aa-72d3-4185-874e-eb0c2f6ba0db tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:22:19.186178 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-734779aa-72d3-4185-874e-eb0c2f6ba0db tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:22:19.366609 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-734779aa-72d3-4185-874e-eb0c2f6ba0db tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: 906e664a-61eb-4e71-9cb9-b8ab0b0a5b64] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 04:22:19.887660 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-734779aa-72d3-4185-874e-eb0c2f6ba0db tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Created allocations for migration 193f0dff-559d-4b01-8f11-04d7020be9f7 on 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:22:20.132489 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-734779aa-72d3-4185-874e-eb0c2f6ba0db tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: 906e664a-61eb-4e71-9cb9-b8ab0b0a5b64] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"9af7e94c-c36e-4570-becd-82af4f5fb2a0": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["9af7e94c-c36e-4570-becd-82af4f5fb2a0"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=9af7e94c-c36e-4570-becd-82af4f5fb2a0,limits=SchedulerLimits,nodename='n-h2-763928-2',service_host='n-h2-763928-2')] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 04:22:24.213174 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:22:25.238136 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34352. Apr 30 04:22:32.417292 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:22:56.226272 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:23:06.026752 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:23:06.070897 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:06.071463 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:06.150942 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:06.151730 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:06.152675 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:06.153232 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:06.172113 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Getting quotas for project 02b2e2471da64170aff0e16c8b1ca7dd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:23:06.177228 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Getting quotas for user 6dca419ffe1c4cd98b27fd902edab2cb and project 02b2e2471da64170aff0e16c8b1ca7dd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:23:06.199698 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] [instance: cdbca78f-a525-4a41-9329-c83d9e88114c] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:23:06.200851 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:06.201410 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:06.209862 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] [instance: cdbca78f-a525-4a41-9329-c83d9e88114c] block_device_mapping [BlockDeviceMapping(attachment_id=904f9386-9e1c-4dc0-a9ff-4d334e3aa1e1,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8bcf69f-c690-403c-9e87-99dc6b25a682',volume_size=1,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:23:06.211275 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:06.212199 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:06.265266 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:06.265893 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d44caab5-056f-4b3c-bdaa-a03f37a83374 tempest-LiveAutoBlockMigrationV225Test-1232440306 tempest-LiveAutoBlockMigrationV225Test-1232440306-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:13.841853 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:23:13.894256 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:13.894675 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:13.997778 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:13.997778 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:14.000689 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:14.001102 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:14.035186 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Getting quotas for project bde5861bd64f4cbdb50ca683c70befc2. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:23:14.047717 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Getting quotas for user 46cc85eff1354ac1a45892ee53b47976 and project bde5861bd64f4cbdb50ca683c70befc2. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:23:14.074926 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] [instance: 5c33ab70-07ed-4353-bcf5-56e61d7c716d] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:23:14.077299 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:14.079615 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:14.105614 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] [instance: 5c33ab70-07ed-4353-bcf5-56e61d7c716d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:23:14.108074 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:14.108854 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:14.180586 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:14.181020 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fd592a44-5e07-444b-9cf1-3ae8f299e321 tempest-ServerAddressesNegativeTestJSON-1974174086 tempest-ServerAddressesNegativeTestJSON-1974174086-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:22.199095 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:23:22.224855 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:22.225260 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:22.280186 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:22.280850 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:22.282059 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:22.282607 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:22.317933 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Getting quotas for project d989bba102ce4824b98c613db6a5afab. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:23:22.328636 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Getting quotas for user 77dbec27f30d4f08b6becad7030cb6e6 and project d989bba102ce4824b98c613db6a5afab. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:23:22.343286 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: c60cf871-5096-498b-83d4-f6349daa31b5] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:23:22.344662 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:22.345307 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:22.353519 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] [instance: c60cf871-5096-498b-83d4-f6349daa31b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:23:22.355758 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:22.356404 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:22.409016 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:22.409460 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d6ad5f80-f956-48a4-840e-f1d223d9c180 tempest-MigrationsAdminTest-830612751 tempest-MigrationsAdminTest-830612751-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:29.867022 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:23:29.903405 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:29.903405 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:29.972570 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:29.973304 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:29.974033 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:29.974761 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:29.996573 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Getting quotas for project 04acf35f0783435a80aa143e5a31933c. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:23:30.001848 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Getting quotas for user 692b65190d8843e0ae587e6b0d0b94fb and project 04acf35f0783435a80aa143e5a31933c. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:23:30.014532 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] [instance: b17aae90-7c8a-4bb7-ba6a-4d3fcc8cad76] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:23:30.015643 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:30.016047 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:30.023258 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] [instance: b17aae90-7c8a-4bb7-ba6a-4d3fcc8cad76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:23:30.024861 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:30.026081 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:30.062707 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:30.063219 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4b70a9bd-864c-425b-a623-0d5501c56fc1 tempest-ImagesOneServerTestJSON-24512911 tempest-ImagesOneServerTestJSON-24512911-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:34.577592 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-667fb6de-11dd-4a75-af18-56e16487d817 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:23:34.578245 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-667fb6de-11dd-4a75-af18-56e16487d817 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:34.578860 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-667fb6de-11dd-4a75-af18-56e16487d817 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:35.021381 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-667fb6de-11dd-4a75-af18-56e16487d817 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Created allocations for migration f5e6652f-f4c0-41be-a159-b119f8b9a392 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:23:35.146147 n-d-763928-2 nova-conductor[80830]: DEBUG nova.scheduler.utils [None req-667fb6de-11dd-4a75-af18-56e16487d817 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] [instance: cdbca78f-a525-4a41-9329-c83d9e88114c] Instance allocations successfully created on destination node 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8: {'allocations': {'1508a0ee-85c8-42eb-a6ba-5ec68c136fa8': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=80830) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 30 04:23:35.146576 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-667fb6de-11dd-4a75-af18-56e16487d817 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lazy-loading 'resources' on Instance uuid cdbca78f-a525-4a41-9329-c83d9e88114c {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:23:35.153597 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-667fb6de-11dd-4a75-af18-56e16487d817 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] Lazy-loading 'pci_requests' on Instance uuid cdbca78f-a525-4a41-9329-c83d9e88114c {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:23:35.435541 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.live_migrate [None req-667fb6de-11dd-4a75-af18-56e16487d817 tempest-LiveAutoBlockMigrationV225Test-1287605718 tempest-LiveAutoBlockMigrationV225Test-1287605718-project-admin] [instance: cdbca78f-a525-4a41-9329-c83d9e88114c] Start binding ports on destination host: n-h1-763928-2 {{(pid=80830) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 30 04:23:39.611741 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:23:39.642758 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:39.643798 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:39.728292 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:39.729898 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:39.730770 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:39.731274 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:39.750852 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Getting quotas for project 7a3a7db68fa7426a966a8a783b14b93f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:23:39.755864 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Getting quotas for user e463c3fbc1b64d55b598ddbdbf616bc2 and project 7a3a7db68fa7426a966a8a783b14b93f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:23:39.769495 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] [instance: b73da9b8-a614-43a2-ba1d-3ce56a4de019] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:23:39.770925 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:39.771639 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:39.789015 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] [instance: b73da9b8-a614-43a2-ba1d-3ce56a4de019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:23:39.790451 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:39.791809 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:39.840617 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:39.841392 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5024930a-2f40-4c3e-8cfe-51c7b614799a tempest-InstanceActionsTestJSON-517279927 tempest-InstanceActionsTestJSON-517279927-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:42.615438 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9af0aa5a-c357-4822-bd6d-3f298299026b tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:23:42.619395 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9af0aa5a-c357-4822-bd6d-3f298299026b tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:42.620024 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9af0aa5a-c357-4822-bd6d-3f298299026b tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:43.030197 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-9af0aa5a-c357-4822-bd6d-3f298299026b tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] [instance: c60cf871-5096-498b-83d4-f6349daa31b5] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80830) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 04:23:43.563285 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-9af0aa5a-c357-4822-bd6d-3f298299026b tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] Created allocations for migration 69e4c735-42bf-4333-9000-cbe3186d62f1 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:23:43.828117 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-9af0aa5a-c357-4822-bd6d-3f298299026b tempest-MigrationsAdminTest-733708485 tempest-MigrationsAdminTest-733708485-project-admin] [instance: c60cf871-5096-498b-83d4-f6349daa31b5] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80830) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 04:23:57.664963 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:23:57.713960 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:57.716865 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:57.818288 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:57.820131 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:57.821402 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:57.822901 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:57.849514 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Getting quotas for project d6043ef26d824d8386ec051162849ff8. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:23:57.855101 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Getting quotas for user bb4101c3edc54510bbc2e6244206ed6a and project d6043ef26d824d8386ec051162849ff8. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:23:57.871108 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] [instance: c3d11fd7-be08-466d-830e-35eb25e1cafe] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:23:57.872352 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:57.872924 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:57.885508 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] [instance: c3d11fd7-be08-466d-830e-35eb25e1cafe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:23:57.887389 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:57.888073 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:23:57.942278 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:23:57.944143 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-07828ef7-00c7-42d4-9799-8a3a3746d7df tempest-ServerRescueTestJSONUnderV235-1603046339 tempest-ServerRescueTestJSONUnderV235-1603046339-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:11.975341 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:24:12.022604 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:12.024667 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:12.111930 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:12.113222 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:12.114469 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:12.116472 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:12.146526 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Getting quotas for project d9f6508034454ba3a2840d6aea4a5554. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:24:12.152123 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Getting quotas for user 956e0b27ef01442188a358cc3cbebc7e and project d9f6508034454ba3a2840d6aea4a5554. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:24:12.179283 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] [instance: eab208de-5128-4b1f-8f00-fd0c44538b55] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:24:12.183386 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:12.184141 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:12.205406 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] [instance: eab208de-5128-4b1f-8f00-fd0c44538b55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:24:12.207044 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:12.208047 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:12.272536 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:12.273660 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d67987dc-eb47-4873-89fa-93093542aa7c tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:14.846106 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:24:14.882331 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:14.882829 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:14.992811 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:14.993216 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:14.994479 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:14.997350 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:15.028701 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Getting quotas for project d9f6508034454ba3a2840d6aea4a5554. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:24:15.034702 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Getting quotas for user 956e0b27ef01442188a358cc3cbebc7e and project d9f6508034454ba3a2840d6aea4a5554. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:24:15.046184 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] [instance: bea9c633-d65b-4068-b518-4872bfee43e6] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:24:15.047393 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:15.047960 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:15.056464 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] [instance: bea9c633-d65b-4068-b518-4872bfee43e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:24:15.057774 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:15.058187 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:15.119211 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:15.119652 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-380557ec-271c-4556-9454-0f41dc91f402 tempest-ListImageFiltersTestJSON-1683802058 tempest-ListImageFiltersTestJSON-1683802058-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:34.382309 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:24:34.413763 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:34.414165 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:34.492016 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:34.493032 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:34.494200 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:34.494746 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:34.518729 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Getting quotas for project 5b0ff4255a7143b788506dcc64cd4e58. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:24:34.526264 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Getting quotas for user 09ecca7ae93b4b89a1db6c4fd1d912c3 and project 5b0ff4255a7143b788506dcc64cd4e58. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:24:34.558380 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] [instance: b7a6e4a7-6564-410b-b422-b7f469e9ae60] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:24:34.562518 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:34.566942 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:34.585110 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] [instance: b7a6e4a7-6564-410b-b422-b7f469e9ae60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:24:34.588131 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:34.588869 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:34.644749 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:34.645424 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0527336c-0996-4e88-85c5-e64555a483aa tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:38.015738 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:24:38.059910 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:38.063408 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:38.162051 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:38.162748 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:38.163658 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:38.164246 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:38.191982 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Getting quotas for project c360bbd6bd68484fb9c80e5d2695939b. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:24:38.201938 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Getting quotas for user b49bb4f2f7384a1b9a21e16a99536d7e and project c360bbd6bd68484fb9c80e5d2695939b. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:24:38.223994 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] [instance: 28e8b9ab-db60-4ff8-95a9-ccff6c29af58] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:24:38.227247 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:38.228399 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:38.246077 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] [instance: 28e8b9ab-db60-4ff8-95a9-ccff6c29af58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:24:38.249956 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:38.258324 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:38.329165 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:24:38.329774 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e4fb31dc-b898-4927-bdd3-08fde3b33954 tempest-ServerAddressesTestJSON-243927631 tempest-ServerAddressesTestJSON-243927631-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:24:47.160028 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:24:48.185326 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37400. Apr 30 04:25:14.420179 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:25:14.446098 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:14.446639 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:14.502422 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:14.502840 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:14.503578 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:14.503978 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:14.522862 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Getting quotas for project a3a23ef61fdf4b7ab0cb73eac38cfbd9. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:25:14.527974 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Getting quotas for user b9caa87dedd34087b291c27faf9498c5 and project a3a23ef61fdf4b7ab0cb73eac38cfbd9. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:25:14.540359 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] [instance: 3da807e9-508e-45d2-8830-b6b4a4d8f204] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:25:14.541325 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:14.541896 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:14.549691 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] [instance: 3da807e9-508e-45d2-8830-b6b4a4d8f204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:25:14.551286 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:14.552104 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:14.590880 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:14.591289 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9653f524-a0d8-4675-ba3e-bbaea6d1d9cf tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:20.325880 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:25:20.347655 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:20.347994 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:20.395679 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:20.396146 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:20.397772 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:20.397772 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:20.412631 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Getting quotas for project 40fa807bb0974883b80bb275be0f920c. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:25:20.417717 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Getting quotas for user ffc297fda6fd4dea8941b24f4977fc9b and project 40fa807bb0974883b80bb275be0f920c. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:25:20.428050 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] [instance: 1cfdf4ec-5dce-4520-bcb1-42552ae7b49e] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:25:20.429013 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:20.429409 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:20.436679 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] [instance: 1cfdf4ec-5dce-4520-bcb1-42552ae7b49e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:25:20.438707 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:20.439221 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:20.467681 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:20.468081 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d51c20fb-e6af-4f2b-8dc3-45f9a148b998 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:24.876948 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:25:24.917852 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:24.918525 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:24.972430 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:24.972840 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:24.973558 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:24.973945 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:24.989567 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Getting quotas for project 40fa807bb0974883b80bb275be0f920c. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:25:24.995204 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Getting quotas for user ffc297fda6fd4dea8941b24f4977fc9b and project 40fa807bb0974883b80bb275be0f920c. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:25:25.006010 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] [instance: 6e7b4f3f-0ced-4852-8942-38b3dbd48a32] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:25:25.006960 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:25.007354 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:25.014629 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] [instance: 6e7b4f3f-0ced-4852-8942-38b3dbd48a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:25:25.015841 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:25.016239 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:25.049232 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:25.049765 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d19147b4-27e2-4d4d-a7ee-2383de058cb3 tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:33.157813 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c7ffc6ad-eb71-4846-b735-24c54ae3045e tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method rebuild_instance {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:25:33.158933 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7ffc6ad-eb71-4846-b735-24c54ae3045e tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:33.159520 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7ffc6ad-eb71-4846-b735-24c54ae3045e tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:33.189865 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c7ffc6ad-eb71-4846-b735-24c54ae3045e tempest-ServerShowV247Test-274394431 tempest-ServerShowV247Test-274394431-project] [instance: 6e7b4f3f-0ced-4852-8942-38b3dbd48a32] No migration record for the rebuild/evacuate request. {{(pid=80831) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 30 04:25:49.798569 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:25:49.829749 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:49.830357 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:49.883162 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:49.883620 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:49.884285 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:49.884770 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:49.902859 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Getting quotas for project 5b0ff4255a7143b788506dcc64cd4e58. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:25:49.907704 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Getting quotas for user 09ecca7ae93b4b89a1db6c4fd1d912c3 and project 5b0ff4255a7143b788506dcc64cd4e58. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:25:49.921494 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] [instance: 3ca1c50b-5ab0-46c0-84fd-fee9e0b04dc3] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:25:49.922651 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:49.923214 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:49.934918 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] [instance: 3ca1c50b-5ab0-46c0-84fd-fee9e0b04dc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:25:49.936845 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:49.937716 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:49.998077 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:49.998745 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fa-706d-460b-8a78-91083e78f924 tempest-ServersTestMultiNic-1470139523 tempest-ServersTestMultiNic-1470139523-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:50.677145 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:25:50.727331 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:50.728185 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:50.850458 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:50.852968 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:50.857951 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:50.858629 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:50.909215 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Getting quotas for project d25cbce431444e668dffc722c91bd8b2. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:25:50.925482 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Getting quotas for user fd3200cabd3748fe83e31ae1f5dfb2c9 and project d25cbce431444e668dffc722c91bd8b2. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:25:50.940105 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] [instance: 441d8637-2a09-4891-8203-155a95a01b21] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:25:50.947294 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:50.948204 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:50.964232 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] [instance: 441d8637-2a09-4891-8203-155a95a01b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:25:50.967054 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:50.967681 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:51.057180 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:51.057910 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5a722209-aced-4d50-921f-6138a2914eb5 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:52.439505 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:25:53.837539 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:25:53.861840 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:53.862618 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:53.938982 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:53.939542 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:53.940444 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:53.941134 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:53.959500 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Getting quotas for project a1763cf2333849a2b581a0a1e6510ea2. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:25:53.965263 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Getting quotas for user 76596fa838e14f5c8fe46909265b8126 and project a1763cf2333849a2b581a0a1e6510ea2. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:25:53.979990 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] [instance: 8a0e9392-5b26-499a-ab44-a8abdfc5e93b] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:25:53.982380 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:53.983575 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:53.996558 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] [instance: 8a0e9392-5b26-499a-ab44-a8abdfc5e93b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:25:53.998868 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:53.999600 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:25:54.058439 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:25:54.058913 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c9ff2a98-6386-4489-a1c4-df310de09cf6 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:02.246978 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7b54a16f-3e3b-4b0f-8dde-c62de03e67f7 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method rebuild_instance {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:26:02.248805 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7b54a16f-3e3b-4b0f-8dde-c62de03e67f7 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:02.250686 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7b54a16f-3e3b-4b0f-8dde-c62de03e67f7 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:02.286905 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7b54a16f-3e3b-4b0f-8dde-c62de03e67f7 tempest-ServerShowV257Test-99044071 tempest-ServerShowV257Test-99044071-project] [instance: 8a0e9392-5b26-499a-ab44-a8abdfc5e93b] No migration record for the rebuild/evacuate request. {{(pid=80831) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 30 04:26:13.697371 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:26:13.781366 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:13.785580 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:13.885682 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:13.890587 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:13.891750 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:13.892404 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:13.930717 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Getting quotas for project a3a23ef61fdf4b7ab0cb73eac38cfbd9. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:26:13.940640 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Getting quotas for user b9caa87dedd34087b291c27faf9498c5 and project a3a23ef61fdf4b7ab0cb73eac38cfbd9. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:26:13.972810 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] [instance: 0e042cc1-cfed-46c2-97d5-af9a4933d29b] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:26:13.973797 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:13.974402 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:13.991706 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] [instance: 0e042cc1-cfed-46c2-97d5-af9a4933d29b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:26:13.995078 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:13.995707 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:14.064858 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:14.065921 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b1b8787c-ddd8-4f62-8f62-8bdbaa5ba666 tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:16.152059 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:26:16.214971 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:16.215392 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:16.303597 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:16.304538 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:16.305520 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:16.306080 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:16.324381 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Getting quotas for project 4aafd235a1134f5d8505d8469192cace. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:26:16.329226 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Getting quotas for user fb56f2830f224069a1370223002d16f1 and project 4aafd235a1134f5d8505d8469192cace. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:26:16.354155 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] [instance: 429847ca-1f0a-44b7-a94e-bc3e856c845e] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:26:16.355827 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:16.356450 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:16.369280 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] [instance: 429847ca-1f0a-44b7-a94e-bc3e856c845e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:26:16.370981 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:16.371555 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:16.432617 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:16.433068 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6f418bb8-fa20-467e-800b-5fc668cd9385 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:18.065040 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:26:18.101344 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:18.102064 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:18.173395 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:18.174170 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:18.175259 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:18.175892 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:18.196602 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Getting quotas for project 9941b7ca3ee5454e81df130e9d1f7d81. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:26:18.202400 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Getting quotas for user d943d748468b434a95646b70731c8ecc and project 9941b7ca3ee5454e81df130e9d1f7d81. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:26:18.214989 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] [instance: 9bbebe87-40cb-4a84-afc6-6c7afc1a0008] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:26:18.216395 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:18.216972 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:18.229094 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] [instance: 9bbebe87-40cb-4a84-afc6-6c7afc1a0008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:26:18.231000 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:18.231815 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:18.294291 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:18.296167 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9802a138-b083-46ec-8f1d-610a74f9599e tempest-FloatingIPsAssociationNegativeTestJSON-272974029 tempest-FloatingIPsAssociationNegativeTestJSON-272974029-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:19.110406 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:26:19.189761 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:19.191316 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:19.258110 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:19.259373 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:19.260457 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:19.261307 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:19.286594 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Getting quotas for project d25cbce431444e668dffc722c91bd8b2. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:26:19.292248 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Getting quotas for user fd3200cabd3748fe83e31ae1f5dfb2c9 and project d25cbce431444e668dffc722c91bd8b2. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:26:19.305627 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] [instance: 21ce1618-4e8a-4cf1-8fac-15828988eebd] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:26:19.307209 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:19.307963 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:19.321789 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] [instance: 21ce1618-4e8a-4cf1-8fac-15828988eebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:26:19.324133 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:19.324877 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:19.404536 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:19.405159 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-54f8c19c-9458-48c7-93aa-dfac0bb0c4c2 tempest-ServersAdminNegativeTestJSON-1804076318 tempest-ServersAdminNegativeTestJSON-1804076318-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:25.234702 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:26:26.254959 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39562. Apr 30 04:26:34.054160 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:26:34.077467 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:34.078204 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:34.148203 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:34.148661 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:34.149387 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:34.149786 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:34.178641 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Getting quotas for project 4d26a5b72ab446f28b4eaae37caa6105. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:26:34.193800 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Getting quotas for user b208ab5944fa47148b47c0e5f9fc41bf and project 4d26a5b72ab446f28b4eaae37caa6105. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:26:34.211089 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] [instance: bc2a1f56-bb3d-4563-8cc2-f6b12a96f8c8] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:26:34.212060 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:34.212698 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:34.222768 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] [instance: bc2a1f56-bb3d-4563-8cc2-f6b12a96f8c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:26:34.224291 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:34.225902 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:34.259906 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:34.260875 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7b6a3ed0-6a1f-49aa-acb6-e5c1fb4f2d10 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:44.510792 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-dc442f28-1555-42cf-802c-9196214c64b5 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method rebuild_instance {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:26:44.511333 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-dc442f28-1555-42cf-802c-9196214c64b5 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:44.511679 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-dc442f28-1555-42cf-802c-9196214c64b5 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:44.527868 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-dc442f28-1555-42cf-802c-9196214c64b5 tempest-ServerShowV254Test-176767837 tempest-ServerShowV254Test-176767837-project] [instance: bc2a1f56-bb3d-4563-8cc2-f6b12a96f8c8] No migration record for the rebuild/evacuate request. {{(pid=80831) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 30 04:26:44.815346 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-93c06585-9292-4525-be2e-3a278f152335 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:26:44.815958 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-93c06585-9292-4525-be2e-3a278f152335 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:44.816287 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-93c06585-9292-4525-be2e-3a278f152335 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:45.159042 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-93c06585-9292-4525-be2e-3a278f152335 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Created allocations for migration 4c69ecbb-03d3-4481-ac7f-a4a7eb7312c1 on 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:26:45.307176 n-d-763928-2 nova-conductor[80830]: DEBUG nova.scheduler.utils [None req-93c06585-9292-4525-be2e-3a278f152335 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] [instance: 429847ca-1f0a-44b7-a94e-bc3e856c845e] Instance allocations successfully created on destination node 9af7e94c-c36e-4570-becd-82af4f5fb2a0: {'allocations': {'9af7e94c-c36e-4570-becd-82af4f5fb2a0': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=80830) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 30 04:26:45.307605 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-93c06585-9292-4525-be2e-3a278f152335 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lazy-loading 'resources' on Instance uuid 429847ca-1f0a-44b7-a94e-bc3e856c845e {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:26:45.312190 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-93c06585-9292-4525-be2e-3a278f152335 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lazy-loading 'pci_requests' on Instance uuid 429847ca-1f0a-44b7-a94e-bc3e856c845e {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:26:45.709017 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.live_migrate [None req-93c06585-9292-4525-be2e-3a278f152335 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] [instance: 429847ca-1f0a-44b7-a94e-bc3e856c845e] Start binding ports on destination host: n-h2-763928-2 {{(pid=80830) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 30 04:26:56.512230 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:26:56.543834 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:56.544568 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:56.599182 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:56.600648 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:56.601587 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:56.602137 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:56.623235 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Getting quotas for project a3a23ef61fdf4b7ab0cb73eac38cfbd9. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:26:56.628536 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Getting quotas for user b9caa87dedd34087b291c27faf9498c5 and project a3a23ef61fdf4b7ab0cb73eac38cfbd9. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:26:56.641416 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] [instance: 386bd9ea-9b38-4896-8567-12de636a926e] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:26:56.642366 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:56.643176 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:56.656408 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] [instance: 386bd9ea-9b38-4896-8567-12de636a926e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:26:56.658585 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:56.658585 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:26:56.720401 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:26:56.721005 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0789456b-be12-41fe-be48-2b27b4af1e7d tempest-ImagesOneServerNegativeTestJSON-1071455137 tempest-ImagesOneServerNegativeTestJSON-1071455137-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:06.365719 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:27:06.403013 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:06.403652 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:06.463852 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:06.464363 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:06.465268 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:06.465670 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:06.487429 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Getting quotas for project bf1b710b02704a129649e75187412579. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:27:06.494513 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Getting quotas for user bad77c803a9f4267bb9b78635139e446 and project bf1b710b02704a129649e75187412579. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:27:06.509539 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] [instance: 6ae5e89b-f8ee-4145-aabc-1e2174d9015a] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:27:06.510804 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:06.511550 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:06.519718 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] [instance: 6ae5e89b-f8ee-4145-aabc-1e2174d9015a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:27:06.521969 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:06.522563 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:06.562468 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:06.563181 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0624d59f-fc7e-4684-9fe6-cbf7636a6356 tempest-InstanceActionsV221TestJSON-1554497668 tempest-InstanceActionsV221TestJSON-1554497668-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:07.444982 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:27:07.517077 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:07.521718 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:07.587698 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:07.588428 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:07.590358 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:07.592362 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:07.617723 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Getting quotas for project 4aafd235a1134f5d8505d8469192cace. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:27:07.625787 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Getting quotas for user fb56f2830f224069a1370223002d16f1 and project 4aafd235a1134f5d8505d8469192cace. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:27:07.658577 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] [instance: af4632c8-2117-4065-965d-91e5e40a758f] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:27:07.664112 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:07.664830 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:07.679541 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] [instance: af4632c8-2117-4065-965d-91e5e40a758f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:27:07.680945 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:07.681397 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:07.732422 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:07.733032 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-eac5f346-d6b6-4934-b773-84e224919a46 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:33.703826 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:27:33.746505 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:33.746996 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:33.903522 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:33.904110 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:33.905583 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:33.906128 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:33.950910 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Getting quotas for project 6b9b80ef2c4744a5b9ea91a88a3d0e5e. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:27:33.971877 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Getting quotas for user 386a450805fe474b888a710492737f74 and project 6b9b80ef2c4744a5b9ea91a88a3d0e5e. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:27:34.004865 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] [instance: 89a4b03e-da56-4918-a384-a13297eebf0a] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:27:34.006791 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:34.006941 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:34.030287 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] [instance: 89a4b03e-da56-4918-a384-a13297eebf0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:27:34.033748 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:34.036607 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:34.103497 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:34.103917 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bb741d51-9b81-4df4-99d1-f301655b3ba0 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:37.541211 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:27:37.568927 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:37.569521 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:37.631148 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:37.631593 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:37.632813 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:37.633643 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:37.652028 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Getting quotas for project 0e22ea51181045438213f10a323aa8c1. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:27:37.657497 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Getting quotas for user ace96e97171441b3bc4b0081b8a92906 and project 0e22ea51181045438213f10a323aa8c1. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:27:37.681624 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] [instance: a7c469e5-2051-4bc8-92f1-801c0c3b9d8d] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:27:37.685468 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:37.689031 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:37.707001 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] [instance: a7c469e5-2051-4bc8-92f1-801c0c3b9d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:27:37.710017 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:37.710562 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:37.778223 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:37.778736 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0cea0ba6-d9f8-4fe4-b4ca-9231456a8949 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:42.298293 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-319a677a-cbe3-4463-b438-dd6270d1848c tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:27:42.299468 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-319a677a-cbe3-4463-b438-dd6270d1848c tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:42.300041 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-319a677a-cbe3-4463-b438-dd6270d1848c tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:43.461103 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-319a677a-cbe3-4463-b438-dd6270d1848c tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Created allocations for migration 6c6b6878-b847-4d4e-a1c7-385cdb0def86 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:27:43.598896 n-d-763928-2 nova-conductor[80830]: DEBUG nova.scheduler.utils [None req-319a677a-cbe3-4463-b438-dd6270d1848c tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] [instance: af4632c8-2117-4065-965d-91e5e40a758f] Instance allocations successfully created on destination node 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8: {'allocations': {'1508a0ee-85c8-42eb-a6ba-5ec68c136fa8': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=80830) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 30 04:27:43.599336 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-319a677a-cbe3-4463-b438-dd6270d1848c tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lazy-loading 'resources' on Instance uuid af4632c8-2117-4065-965d-91e5e40a758f {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:27:43.604268 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-319a677a-cbe3-4463-b438-dd6270d1848c tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lazy-loading 'pci_requests' on Instance uuid af4632c8-2117-4065-965d-91e5e40a758f {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:27:43.857335 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.live_migrate [None req-319a677a-cbe3-4463-b438-dd6270d1848c tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] [instance: af4632c8-2117-4065-965d-91e5e40a758f] Start binding ports on destination host: n-h1-763928-2 {{(pid=80830) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 30 04:27:48.188749 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:27:49.211628 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41786. Apr 30 04:27:53.197582 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:27:53.232724 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:53.233391 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:53.305546 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:53.306331 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:53.307272 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:53.307896 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:53.326703 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Getting quotas for project 7c4a3b2ab3bd4ff4aa63d7b246cc4b77. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:27:53.331422 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Getting quotas for user 2ae34088c6d9453bb1e22515e5d885da and project 7c4a3b2ab3bd4ff4aa63d7b246cc4b77. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:27:53.343585 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] [instance: 7bcc7374-1835-4639-84dd-fb4f3de00904] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:27:53.344971 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:53.344971 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:53.353375 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] [instance: 7bcc7374-1835-4639-84dd-fb4f3de00904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:27:53.354990 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:53.355380 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:53.389567 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:53.389982 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e12f23-8a53-4d0e-8290-d4a4dbaa670a tempest-ServerPasswordTestJSON-578705365 tempest-ServerPasswordTestJSON-578705365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:59.621795 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:27:59.672878 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:59.677856 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:59.748652 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:59.749261 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:59.749964 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:59.750644 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:59.768890 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Getting quotas for project 6b9b80ef2c4744a5b9ea91a88a3d0e5e. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:27:59.774035 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Getting quotas for user 386a450805fe474b888a710492737f74 and project 6b9b80ef2c4744a5b9ea91a88a3d0e5e. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:27:59.802758 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] [instance: e88742f2-bfef-4410-9af6-5a329497d3cd] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:27:59.803731 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:59.804637 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:59.827755 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] [instance: e88742f2-bfef-4410-9af6-5a329497d3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:27:59.829450 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:59.829900 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:27:59.891173 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:27:59.891577 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3354e83a-057a-4bdb-a248-01f0a00e5b65 tempest-FloatingIPsAssociationTestJSON-478701483 tempest-FloatingIPsAssociationTestJSON-478701483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:04.219329 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:28:04.260295 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:04.260718 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:04.321426 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:04.322136 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:04.323031 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:04.323585 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:04.351263 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Getting quotas for project 4aafd235a1134f5d8505d8469192cace. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:28:04.357365 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Getting quotas for user fb56f2830f224069a1370223002d16f1 and project 4aafd235a1134f5d8505d8469192cace. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:28:04.371078 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] [instance: 76a29255-02ac-4e4e-95f1-bbdc2b7ca7f4] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:28:04.372235 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:04.372911 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:04.389638 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] [instance: 76a29255-02ac-4e4e-95f1-bbdc2b7ca7f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:28:04.393578 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:04.394208 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:04.445949 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:04.447222 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-e2d5ec9a-1661-478d-98c6-a1757e1e20c4 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:39.281444 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:28:39.348469 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:39.348885 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:39.442597 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:39.443336 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:39.444270 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:39.444902 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:39.473105 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:28:39.482201 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for user dd69f596913848dc90cc54207c72b92c and project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:28:39.495679 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: df20ad2b-214a-4be4-ad22-a3607d8f420d] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:28:39.497187 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:39.497957 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:39.533633 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: df20ad2b-214a-4be4-ad22-a3607d8f420d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:28:39.537953 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:39.538573 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:28:39.609305 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:28:39.609784 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cdea5017-00af-4848-a8a2-76de52d719c0 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:02.751383 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:29:02.786527 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:02.787226 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:02.869419 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:02.870535 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:02.871362 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:02.872001 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:02.892520 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Getting quotas for project 0e22ea51181045438213f10a323aa8c1. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:29:02.899196 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Getting quotas for user ace96e97171441b3bc4b0081b8a92906 and project 0e22ea51181045438213f10a323aa8c1. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:29:02.913960 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] [instance: 74d375e4-9ec4-49e8-8e13-949741068c22] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:29:02.915871 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:02.916826 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:02.926087 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] [instance: 74d375e4-9ec4-49e8-8e13-949741068c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:29:02.928066 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:02.929038 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:02.986982 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:02.987611 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4eed1b7e-04b8-40e9-ba26-f58623b334f8 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:12.465373 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:29:13.720446 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:29:13.754527 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:13.754933 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:13.821584 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:13.821989 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:13.823223 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:13.823822 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:13.844910 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Getting quotas for project ddc712705a974b6cb565576559467ff6. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:29:13.850030 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Getting quotas for user a12b5011dac9434bbef4506aafb9d256 and project ddc712705a974b6cb565576559467ff6. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:29:13.860705 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] [instance: 140c5c5a-62dc-4c6a-8776-f35b8cb0ae40] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:29:13.861954 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:13.862577 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:13.874838 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] [instance: 140c5c5a-62dc-4c6a-8776-f35b8cb0ae40] block_device_mapping [BlockDeviceMapping(attachment_id=cba50986-1ea1-4c88-afa4-5f72630b92bb,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1db2ead4-4644-444c-86d4-b51e87e15050',volume_size=1,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:29:13.876492 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:13.876947 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:13.913810 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:13.914297 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-28bdd623-d456-4971-9d9f-c7d84bff9144 tempest-ServersTestBootFromVolume-47179833 tempest-ServersTestBootFromVolume-47179833-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:15.083965 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:29:15.124565 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:15.131685 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:15.255913 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:15.261736 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:15.264534 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:15.265588 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:15.329260 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:29:15.341875 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for user dd69f596913848dc90cc54207c72b92c and project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:29:15.354658 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: c48e9cb1-96c3-4a51-b464-6d014a4d5e76] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:29:15.356520 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:15.357193 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:15.366082 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: c48e9cb1-96c3-4a51-b464-6d014a4d5e76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:29:15.367721 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:15.369266 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:15.411772 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:15.412569 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4ca377ad-fbb3-4a01-b911-fcee0c8e0b8d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:17.997026 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-8fab5819-da0b-4043-99cf-eb1a869f2f51 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:29:18.007966 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8fab5819-da0b-4043-99cf-eb1a869f2f51 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:18.009182 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8fab5819-da0b-4043-99cf-eb1a869f2f51 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:18.603713 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-8fab5819-da0b-4043-99cf-eb1a869f2f51 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Created allocations for migration 417d4f79-7762-425f-ac35-4f89a071688b on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:29:18.744567 n-d-763928-2 nova-conductor[80830]: DEBUG nova.scheduler.utils [None req-8fab5819-da0b-4043-99cf-eb1a869f2f51 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] [instance: 76a29255-02ac-4e4e-95f1-bbdc2b7ca7f4] Instance allocations successfully created on destination node 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8: {'allocations': {'1508a0ee-85c8-42eb-a6ba-5ec68c136fa8': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=80830) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 30 04:29:18.745210 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-8fab5819-da0b-4043-99cf-eb1a869f2f51 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lazy-loading 'resources' on Instance uuid 76a29255-02ac-4e4e-95f1-bbdc2b7ca7f4 {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:29:18.750747 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-8fab5819-da0b-4043-99cf-eb1a869f2f51 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lazy-loading 'pci_requests' on Instance uuid 76a29255-02ac-4e4e-95f1-bbdc2b7ca7f4 {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:29:19.192833 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.live_migrate [None req-8fab5819-da0b-4043-99cf-eb1a869f2f51 tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] [instance: 76a29255-02ac-4e4e-95f1-bbdc2b7ca7f4] Start binding ports on destination host: n-h1-763928-2 {{(pid=80830) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 30 04:29:36.250398 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:29:47.490678 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:29:47.551398 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:47.552614 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:47.663585 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:47.664006 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:47.665082 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:47.665486 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:47.709826 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:29:47.718197 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for user dd69f596913848dc90cc54207c72b92c and project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:29:47.745719 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 0e20dad0-0170-4984-b7a8-7bd32bf2b21f] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:29:47.747002 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:47.747615 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:47.758483 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 0e20dad0-0170-4984-b7a8-7bd32bf2b21f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:29:47.760225 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:47.760981 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:29:47.811018 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:29:47.814588 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b4c5e1f0-05d7-4552-8cfc-6d2e8adc3726 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:14.367439 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:30:14.459076 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:14.460302 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:14.588545 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:14.593553 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:14.595216 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:14.595813 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:14.650620 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:30:14.660778 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for user 27c229be37d64be29d5b13a0a6999d16 and project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:30:14.694869 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: f5cf4d52-17b2-408d-a12c-581ab55ba362] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:30:14.697671 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:14.699421 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:14.712743 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: f5cf4d52-17b2-408d-a12c-581ab55ba362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:30:14.714763 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:14.718028 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:14.789010 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:14.789799 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-89f891d1-c0da-497b-ad7f-9034e72fa7b5 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:41.793379 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:30:41.820452 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:41.821094 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:41.875727 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:41.876144 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:41.877653 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:41.878232 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:41.901242 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Getting quotas for project 4aafd235a1134f5d8505d8469192cace. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:30:41.906960 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Getting quotas for user fb56f2830f224069a1370223002d16f1 and project 4aafd235a1134f5d8505d8469192cace. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:30:41.920484 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] [instance: 516fa0d7-ee3d-4948-af0a-8b9952e20e19] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:30:41.921766 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:41.922459 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:41.930035 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] [instance: 516fa0d7-ee3d-4948-af0a-8b9952e20e19] block_device_mapping [BlockDeviceMapping(attachment_id=a8c069f8-e267-42fc-abc9-40d59acdd2fb,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b064d62a-b7c4-4287-a376-630782b54058',volume_size=1,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:30:41.931761 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:41.932542 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:41.965036 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:41.965463 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-772ef861-471a-436c-a07c-63685945f5f2 tempest-LiveMigrationTest-1931825088 tempest-LiveMigrationTest-1931825088-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:45.877056 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:30:45.922156 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:45.922563 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:46.012348 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:46.013965 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:46.015453 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:46.016855 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:46.046199 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Getting quotas for project 0e22ea51181045438213f10a323aa8c1. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:30:46.057017 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Getting quotas for user ace96e97171441b3bc4b0081b8a92906 and project 0e22ea51181045438213f10a323aa8c1. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:30:46.079181 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] [instance: b7626bfd-0adc-45d7-8142-70c0b15f5b5a] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:30:46.083444 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:46.083856 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:46.103862 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] [instance: b7626bfd-0adc-45d7-8142-70c0b15f5b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:30:46.105159 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:46.105564 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:46.152931 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:46.153592 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-19ff513a-13b7-401d-b99b-569bb723fe5e tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:49.212395 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:30:50.263323 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 46326. Apr 30 04:30:52.141911 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:30:52.191568 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:52.191933 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:52.274629 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:52.275091 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:52.275824 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:52.276218 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:52.309404 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:30:52.319589 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for user 27c229be37d64be29d5b13a0a6999d16 and project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:30:52.331972 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: 2f7cd733-9d0c-437f-a904-bb09f34eb772] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:30:52.333196 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:52.341383 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:52.349987 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: 2f7cd733-9d0c-437f-a904-bb09f34eb772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:30:52.351669 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:52.352209 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:52.395748 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:52.396160 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-847c1dd4-2e35-47fd-9172-7e129d561329 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:55.577539 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:30:55.602576 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:55.603101 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:55.650556 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:55.651144 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:55.651934 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:55.652434 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:55.668416 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:30:55.673476 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for user dd69f596913848dc90cc54207c72b92c and project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:30:55.685478 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 1665caee-965c-4ac4-b7c8-5d71cefe362b] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:30:55.686455 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:55.686873 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:55.696958 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 1665caee-965c-4ac4-b7c8-5d71cefe362b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:30:55.698546 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:55.698844 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:30:55.729747 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:30:55.730234 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-56d3eb88-2dc1-47ba-83d4-94e130182001 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:08.935840 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:31:08.977754 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:08.978174 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:09.071417 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:09.072963 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:09.074754 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:09.076870 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:09.143353 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Getting quotas for project 3d3af8ef36124332a5e5f30666437c24. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:31:09.155525 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Getting quotas for user 0bf48d2eb51b41b9a08110ba21f0cde0 and project 3d3af8ef36124332a5e5f30666437c24. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:31:09.170761 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] [instance: c3737f77-8406-4182-beb8-7fee148572be] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:31:09.171734 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:09.172134 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:09.184122 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] [instance: c3737f77-8406-4182-beb8-7fee148572be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:31:09.185468 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:09.185875 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:09.232349 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:09.232760 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5d3b0918-8af4-4fa1-b711-dec85acd0de9 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:23.121446 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2a397053-f9f5-4a4c-b44e-c631f03a5dba tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:31:23.125873 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2a397053-f9f5-4a4c-b44e-c631f03a5dba tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:23.129381 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2a397053-f9f5-4a4c-b44e-c631f03a5dba tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:24.120140 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-2a397053-f9f5-4a4c-b44e-c631f03a5dba tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Created allocations for migration e514d619-0275-499d-82da-601e7bc78789 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:31:24.478230 n-d-763928-2 nova-conductor[80830]: DEBUG nova.scheduler.utils [None req-2a397053-f9f5-4a4c-b44e-c631f03a5dba tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] [instance: 516fa0d7-ee3d-4948-af0a-8b9952e20e19] Instance allocations successfully created on destination node 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8: {'allocations': {'1508a0ee-85c8-42eb-a6ba-5ec68c136fa8': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=80830) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 30 04:31:24.479422 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-2a397053-f9f5-4a4c-b44e-c631f03a5dba tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lazy-loading 'resources' on Instance uuid 516fa0d7-ee3d-4948-af0a-8b9952e20e19 {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:31:24.485403 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-2a397053-f9f5-4a4c-b44e-c631f03a5dba tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] Lazy-loading 'pci_requests' on Instance uuid 516fa0d7-ee3d-4948-af0a-8b9952e20e19 {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:31:24.938029 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.live_migrate [None req-2a397053-f9f5-4a4c-b44e-c631f03a5dba tempest-LiveMigrationTest-2138782646 tempest-LiveMigrationTest-2138782646-project-admin] [instance: 516fa0d7-ee3d-4948-af0a-8b9952e20e19] Start binding ports on destination host: n-h1-763928-2 {{(pid=80830) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 30 04:31:32.329085 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:31:32.382298 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:32.383151 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:32.501972 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:32.503030 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:32.504378 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:32.505049 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:32.539049 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:31:32.551922 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for user dd69f596913848dc90cc54207c72b92c and project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:31:32.577699 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 6db94616-d018-4c2f-bb01-fb25625976b6] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:31:32.582468 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:32.585621 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:32.600164 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 6db94616-d018-4c2f-bb01-fb25625976b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:31:32.602048 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:32.602739 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:32.664988 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:32.665651 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-7798c37d-6a1e-4928-be10-77949d13512d tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:38.912021 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-12667d5b-0ee1-4773-8cdc-8831086d9e38 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method rebuild_instance {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:31:38.912643 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-12667d5b-0ee1-4773-8cdc-8831086d9e38 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:38.913374 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-12667d5b-0ee1-4773-8cdc-8831086d9e38 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:38.936138 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-12667d5b-0ee1-4773-8cdc-8831086d9e38 tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] [instance: c3737f77-8406-4182-beb8-7fee148572be] No migration record for the rebuild/evacuate request. {{(pid=80830) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 30 04:31:49.964227 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:31:50.040083 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:50.041206 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:50.124118 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:50.127242 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:50.130347 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:50.132464 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:50.169717 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Getting quotas for project 0e22ea51181045438213f10a323aa8c1. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:31:50.181012 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Getting quotas for user ace96e97171441b3bc4b0081b8a92906 and project 0e22ea51181045438213f10a323aa8c1. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:31:50.201307 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] [instance: fe111fcf-5fa4-4454-b0ca-42fc7f546af8] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:31:50.202555 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:50.205098 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:50.215380 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] [instance: fe111fcf-5fa4-4454-b0ca-42fc7f546af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:31:50.216928 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:50.217390 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:31:50.265286 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:31:50.265758 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2aed2864-8474-4810-a08c-9d6b60d24f78 tempest-ImagesTestJSON-1995002993 tempest-ImagesTestJSON-1995002993-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:06.736196 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:32:06.787264 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:06.787946 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:06.884661 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:06.885482 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:06.886483 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:06.887137 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:06.912066 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:32:06.917852 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for user dd69f596913848dc90cc54207c72b92c and project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:32:06.930813 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 58206a08-3194-4475-81ab-bd540655ec17] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:32:06.932620 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:06.933361 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:06.941295 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 58206a08-3194-4475-81ab-bd540655ec17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:32:06.943252 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:06.943929 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:06.979133 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:06.979599 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-ea96c4e5-3652-49be-88a9-c40051f3e446 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:10.920713 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:32:10.966052 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:10.966588 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:11.048740 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:11.049222 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:11.054167 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:11.054647 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:11.099062 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:32:11.103975 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for user 27c229be37d64be29d5b13a0a6999d16 and project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:32:11.129128 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: 504b6eb0-03a6-4074-9bfd-c7517d8088ba] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:32:11.130097 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:11.130495 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:11.142248 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: 504b6eb0-03a6-4074-9bfd-c7517d8088ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:32:11.143516 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:11.143916 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:11.197931 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:11.198372 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-19231df9-dafd-4f07-8c5b-e2c9d7956ed4 tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:41.075551 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:32:41.150764 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:41.151069 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:41.282694 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:41.283027 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:41.283762 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:41.284151 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:41.343055 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Getting quotas for project 3d3af8ef36124332a5e5f30666437c24. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:32:41.353300 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Getting quotas for user 0bf48d2eb51b41b9a08110ba21f0cde0 and project 3d3af8ef36124332a5e5f30666437c24. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:32:41.397679 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] [instance: 0e855ad7-e89b-4ab1-ae5a-a3fc59ec5b8a] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:32:41.398650 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:41.399053 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:41.420778 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] [instance: 0e855ad7-e89b-4ab1-ae5a-a3fc59ec5b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:32:41.423649 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:41.424771 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:41.497245 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:32:41.498158 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2ed67f7b-7fa1-4c4a-9379-c5763803bfdd tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:32:56.284721 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:33:10.748039 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:33:10.776723 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:10.777442 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:10.836911 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:10.837693 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:10.838617 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:10.839234 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:10.859128 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:33:10.868808 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for user 27c229be37d64be29d5b13a0a6999d16 and project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:33:10.884566 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: 21b71899-1cf8-46ce-b263-61475e1059e2] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:33:10.886459 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:10.887073 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:10.903191 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: 21b71899-1cf8-46ce-b263-61475e1059e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:33:10.905055 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:10.907390 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:10.970156 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:10.972124 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-414612f8-fbd7-4066-a431-e65bb510925e tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:18.895754 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-37d8bdfa-6838-4d77-92f6-93050147d2dc tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method rebuild_instance {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:33:18.895754 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-37d8bdfa-6838-4d77-92f6-93050147d2dc tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:18.895754 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-37d8bdfa-6838-4d77-92f6-93050147d2dc tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:18.931438 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-37d8bdfa-6838-4d77-92f6-93050147d2dc tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] [instance: 0e855ad7-e89b-4ab1-ae5a-a3fc59ec5b8a] No migration record for the rebuild/evacuate request. {{(pid=80830) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 30 04:33:21.997332 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:33:22.042346 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:22.042761 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:22.100419 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:22.101310 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:22.102198 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:22.102776 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:22.124088 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:33:22.129810 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for user dd69f596913848dc90cc54207c72b92c and project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:33:22.144351 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 66401200-1a3f-4172-b7df-f706b6c9c5a9] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:33:22.145626 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:22.146221 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:22.157017 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 66401200-1a3f-4172-b7df-f706b6c9c5a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:33:22.159159 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:22.159772 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:22.207028 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:22.208234 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3be9b66d-0958-4d57-82e3-4856d71734da tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:26.259797 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:33:27.288697 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49134. Apr 30 04:33:31.049792 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:33:31.074796 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:31.075079 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:31.130325 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:31.130732 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:31.131458 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:31.132865 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:31.152518 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Getting quotas for project 6f85d0958ba34c55a0024b35b448b288. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:33:31.157000 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Getting quotas for user 9d24edf48ab24d5db5c1cade261fc23c and project 6f85d0958ba34c55a0024b35b448b288. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:33:31.167595 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] [instance: 94985a16-7314-4948-acc6-9b0b2b986756] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:33:31.168777 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:31.169467 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:31.178632 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] [instance: 94985a16-7314-4948-acc6-9b0b2b986756] block_device_mapping [BlockDeviceMapping(attachment_id=f7412e7e-2729-40a5-9d59-18740b774307,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8fc9a75a-57f3-4607-b730-fac7c308e5f8',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=1a49563c-937a-4a7a-87de-e712601990d2,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='20c8ae1f-034e-441d-9890-85f727ea2e0e',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=5476f3f7-0a8a-4586-ba9b-8909737cf152,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46209983-abef-4844-81a9-fcf8a51d0886',volume_size=1,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:33:31.180913 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:31.181562 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:31.191161 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:31.191801 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:31.201096 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:31.201511 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:31.235727 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:31.236475 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-35b24fc5-813b-4d4f-b712-715973a82044 tempest-TaggedBootDevicesTest-1700313358 tempest-TaggedBootDevicesTest-1700313358-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:33.175028 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:33:33.226343 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:33.226754 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:33.391316 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:33.391723 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:33.392550 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:33.392946 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:33.436171 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Getting quotas for project c72299df425c4524b72c60386eaf3fbe. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:33:33.442872 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Getting quotas for user 9e9dc68e96cd427abd2582d70ee48797 and project c72299df425c4524b72c60386eaf3fbe. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:33:33.455886 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] [instance: 8d3f7ff5-bf60-45f2-93f6-c99b7928c448] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:33:33.457031 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:33.457608 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:33.465281 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] [instance: 8d3f7ff5-bf60-45f2-93f6-c99b7928c448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:33:33.466940 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:33.468172 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:33.515929 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:33.516821 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1d72493b-20ab-4cf6-8514-ed2b21169a33 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:50.263481 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 04:33:51.287947 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49806. Apr 30 04:33:51.835189 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:33:51.895262 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:51.895666 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:51.983388 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:51.983851 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:51.985459 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:51.985861 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:52.025191 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Getting quotas for project 3d3af8ef36124332a5e5f30666437c24. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:33:52.030035 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Getting quotas for user 0bf48d2eb51b41b9a08110ba21f0cde0 and project 3d3af8ef36124332a5e5f30666437c24. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:33:52.041300 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] [instance: 777be383-ae7c-493d-92b0-20712d6a31fd] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:33:52.042316 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:52.042723 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:52.050237 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] [instance: 777be383-ae7c-493d-92b0-20712d6a31fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:33:52.051700 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:52.052179 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:52.095971 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:52.096433 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2bdcd6cc-9e8c-4dd9-9ebb-4923ba20fd2f tempest-ServerDiskConfigTestJSON-935115169 tempest-ServerDiskConfigTestJSON-935115169-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:53.046058 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:33:53.077526 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:53.079101 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:53.147444 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:53.148130 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:53.151648 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:53.152211 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:53.179654 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:33:53.186176 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for user 27c229be37d64be29d5b13a0a6999d16 and project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:33:53.212140 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: d9b6fb37-8d5c-4901-9d29-3e6698b21245] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:33:53.215995 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:53.216673 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:53.241636 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: d9b6fb37-8d5c-4901-9d29-3e6698b21245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:33:53.243554 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:53.244013 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:33:53.337716 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:33:53.338925 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-217ae99f-ac5d-48f6-8348-b935fc49e1dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:04.827155 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:34:04.859048 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:04.859822 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:04.907750 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:04.908577 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:04.909402 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:04.909890 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:04.926831 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:34:04.931457 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Getting quotas for user dd69f596913848dc90cc54207c72b92c and project c4b02405795d42efa23119bf1cb44e84. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:34:04.942682 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 5ee8ad6e-f214-40de-945d-7f978bded818] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:34:04.943743 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:04.944244 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:04.952084 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] [instance: 5ee8ad6e-f214-40de-945d-7f978bded818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:34:04.953712 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:04.954222 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:04.987738 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:04.988194 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fc77ce18-eb04-4a0c-a23d-68ace65d0549 tempest-ServersTestJSON-1973630545 tempest-ServersTestJSON-1973630545-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:09.238167 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:34:09.265763 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:09.266534 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:09.325884 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:09.326363 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:09.327367 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:09.327727 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:09.344831 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Getting quotas for project c72299df425c4524b72c60386eaf3fbe. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:34:09.349386 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Getting quotas for user 9e9dc68e96cd427abd2582d70ee48797 and project c72299df425c4524b72c60386eaf3fbe. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:34:09.361755 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] [instance: 7d9c6d35-3753-4b15-85ad-bd6c0c0e4ed5] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:34:09.362725 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:09.363131 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:09.372236 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] [instance: 7d9c6d35-3753-4b15-85ad-bd6c0c0e4ed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:34:09.374544 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:09.375293 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:09.412912 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:09.413359 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b66dfba3-e970-46dd-809c-c8299596e1e1 tempest-LiveMigrationNegativeTest-1539295683 tempest-LiveMigrationNegativeTest-1539295683-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:35.557836 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:34:35.619968 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:35.620413 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:35.743631 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:35.744046 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:35.744957 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:35.745357 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:35.778332 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Getting quotas for project ea3a4acfe9524314827949c64e76047b. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:34:35.790249 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Getting quotas for user 7f753045ac8a48f593b5407516ebea36 and project ea3a4acfe9524314827949c64e76047b. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:34:35.813502 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] [instance: 2fda937d-c6e6-46a9-94f8-319ac100a8ea] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:34:35.815060 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:35.818129 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:35.829020 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] [instance: 2fda937d-c6e6-46a9-94f8-319ac100a8ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:34:35.831853 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:35.832694 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:35.881770 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:35.883873 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f90687b9-f05f-4265-8ae2-5f9bef5519c1 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:49.148246 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:34:49.186697 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:49.187262 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:49.253220 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:49.254377 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:49.255699 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:49.256368 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:49.275099 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:34:49.280934 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for user bf0693c69c9f47ccaf61c1cc9e2ce367 and project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:34:49.291520 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: e5cb320f-ac39-4ad0-b963-be323a00caac] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:34:49.292498 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:49.292898 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:49.300910 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: e5cb320f-ac39-4ad0-b963-be323a00caac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:34:49.302643 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:49.303189 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:49.338950 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:49.339663 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1edcc0cc-1c04-4934-ace7-7a95f9f8da85 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:53.171622 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:34:53.238117 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:53.238781 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:53.417991 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:53.418642 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:53.419599 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:53.420116 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:53.497978 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:34:53.519491 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for user cb0e36bf823c4807be33dd2063439ee7 and project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:34:53.565126 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: 5808ab72-bdbf-43f8-a288-047d1d6817cd] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:34:53.570740 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:53.580663 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:53.606052 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: 5808ab72-bdbf-43f8-a288-047d1d6817cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:34:53.608113 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:53.608553 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:34:53.718574 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:34:53.718991 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-39ac4528-ee47-491c-8723-5e5f53d8b9d5 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:11.886739 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:35:11.922126 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:11.922842 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:11.974078 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:11.974569 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:11.975556 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:11.976114 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:11.994173 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Getting quotas for project ea3a4acfe9524314827949c64e76047b. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:35:12.000152 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Getting quotas for user 7f753045ac8a48f593b5407516ebea36 and project ea3a4acfe9524314827949c64e76047b. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:35:12.011897 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] [instance: ef680fb6-27fe-43b6-8fcb-a8d61b518697] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:35:12.013781 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:12.014191 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:12.022830 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] [instance: ef680fb6-27fe-43b6-8fcb-a8d61b518697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:35:12.024085 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:12.024532 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:12.057176 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:12.057552 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5e40d92e-f4c9-4295-8afc-192ee53e5132 tempest-VolumesActionsTest-719105343 tempest-VolumesActionsTest-719105343-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:22.844984 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:35:22.873134 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:22.873554 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:22.925868 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:22.926306 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:22.927030 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:22.927488 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:22.949317 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:35:22.957815 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for user 27c229be37d64be29d5b13a0a6999d16 and project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:35:22.970223 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: 3f354f56-f269-4f7b-a353-654c8d1fda83] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:35:22.971475 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:22.971948 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:22.982006 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: 3f354f56-f269-4f7b-a353-654c8d1fda83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:35:22.983366 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:22.983738 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:23.014937 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:23.015479 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fcccc7c3-5573-4366-95d9-4efba69394dd tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:25.443536 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:25.444063 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:25.883976 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Took 0.38 seconds to select destinations for 2 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:35:25.912338 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:25.912907 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:25.978320 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:25.979205 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:26.058469 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:26.058891 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:26.060296 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:26.060721 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:26.079941 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:35:26.084624 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for user cb0e36bf823c4807be33dd2063439ee7 and project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:35:26.096632 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: afc6168e-dc32-4306-a6f0-021c4653c77c] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:35:26.098346 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:26.098964 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:26.108342 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: afc6168e-dc32-4306-a6f0-021c4653c77c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:35:26.109787 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:26.110204 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:26.169966 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:26.170963 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:26.198260 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: da68c0fb-9c38-4a38-a67a-283de9aa7baf] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:35:26.198759 n-d-763928-2 nova-conductor[80831]: DEBUG nova.objects.instance_group [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lazy-loading 'hosts' on InstanceGroup uuid 42cf7be9-01fc-40ce-b311-d44a31cc5f07 {{(pid=80831) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Apr 30 04:35:26.222940 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:26.222940 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:26.240928 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: da68c0fb-9c38-4a38-a67a-283de9aa7baf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:35:26.242207 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:26.242614 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:26.297247 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:26.298050 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ba1438db-7251-489e-88ff-7b9d606f3f82 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:42.385053 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:35:42.431669 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:42.432271 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:42.510975 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:42.511640 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:42.513191 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:42.513917 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:42.549715 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Getting quotas for project ec782337e5d04c1ca52506de3f51055c. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:35:42.561784 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Getting quotas for user 84e53091a0484e308ea3a133d49bf590 and project ec782337e5d04c1ca52506de3f51055c. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:35:42.591478 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] [instance: 101bde28-be5c-41e2-b1b4-4d88217b55ec] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:35:42.593109 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:42.594227 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:42.613398 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] [instance: 101bde28-be5c-41e2-b1b4-4d88217b55ec] block_device_mapping [BlockDeviceMapping(attachment_id=e5ec7b88-726a-436f-a156-404ffdd44f2a,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d29a2d3d-59dc-4081-a054-b4a2dc67e87a',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=5333a5ec-a243-417d-a764-e417258efc97,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='530fa99d-3500-47f0-954d-2174db3e78d1',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=738761da-c00e-4e90-940b-80120b55f8e3,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77f84ebb-357f-4812-b9c9-ba870849eb1f',volume_size=1,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:35:42.615950 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:42.617092 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:42.631211 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:42.632076 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:42.649273 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:42.650021 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:35:42.693353 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:35:42.694311 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c6b828d3-0090-41ad-80a8-6a08f5a62ce5 tempest-TaggedBootDevicesTest_v242-624671818 tempest-TaggedBootDevicesTest_v242-624671818-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:11.360798 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:11.361313 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:11.929967 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Took 0.49 seconds to select destinations for 2 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:36:11.954788 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:11.955824 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:12.023018 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:12.023455 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:12.081232 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:12.081983 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:12.083394 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:12.084574 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:12.103942 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:36:12.110767 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for user cb0e36bf823c4807be33dd2063439ee7 and project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:36:12.123941 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: 2474a9ac-d071-48c0-b86a-b143f2318c62] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:36:12.125235 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:12.126101 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:12.134886 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: 2474a9ac-d071-48c0-b86a-b143f2318c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:36:12.136171 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:12.136793 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:12.182098 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:12.182902 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:12.208913 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: 034be313-5e3d-425a-9cc6-e1e1595ca400] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:36:12.209598 n-d-763928-2 nova-conductor[80831]: DEBUG nova.objects.instance_group [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lazy-loading 'hosts' on InstanceGroup uuid b2edd1f4-4abc-44d9-806e-78e721a0aa81 {{(pid=80831) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Apr 30 04:36:12.225089 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:12.225942 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:12.268662 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: 034be313-5e3d-425a-9cc6-e1e1595ca400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:36:12.271942 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:12.274021 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:12.396077 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:12.396961 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0057d405-fb8b-4ad5-8c7c-05bb879a398f tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:16.308754 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:36:27.290119 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:36:28.317537 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52698. Apr 30 04:36:30.701382 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:36:30.728719 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:30.729394 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:30.794627 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:30.795067 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:30.795988 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:30.796583 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:30.815369 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:36:30.824919 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Getting quotas for user 27c229be37d64be29d5b13a0a6999d16 and project ffb14fe4ccfd4be285b84509f3ee82fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:36:30.837354 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: e5c90b27-9458-434e-bb29-65917d841761] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:36:30.839342 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:30.841021 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:30.848944 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] [instance: e5c90b27-9458-434e-bb29-65917d841761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:36:30.850214 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:30.857756 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:30.935390 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:30.936693 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-faa65734-25b0-47e0-bd06-9663d5d2d4da tempest-DeleteServersTestJSON-254741168 tempest-DeleteServersTestJSON-254741168-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:39.869947 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:36:39.894948 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:39.895762 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:39.949714 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:39.950806 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:39.951567 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:39.951961 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:39.976621 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:36:39.981491 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for user cb0e36bf823c4807be33dd2063439ee7 and project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:36:39.993465 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: c70eed8c-7b9d-4d96-ae68-864d72c1b583] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:36:39.994835 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:39.995421 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:40.004071 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: c70eed8c-7b9d-4d96-ae68-864d72c1b583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:36:40.005851 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:40.006435 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:40.042181 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:40.042700 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f1c31da5-7939-4223-8daf-6d76c3a42825 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:51.289196 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:36:52.311725 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53438. Apr 30 04:36:53.890344 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:36:53.926707 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:53.927231 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:53.981868 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:53.982326 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:53.983399 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:53.983990 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:54.005092 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:36:54.013017 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for user cb0e36bf823c4807be33dd2063439ee7 and project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:36:54.024099 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: 51f1108d-89ec-4b13-9afa-c8024124db24] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:36:54.028941 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:54.029902 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:54.036643 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: 51f1108d-89ec-4b13-9afa-c8024124db24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:36:54.037906 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:54.038482 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:36:54.068902 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:36:54.069339 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-8e07a84b-66d2-4733-9fac-048c05546f30 tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:13.051157 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:37:13.131950 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:13.133805 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:13.275958 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:13.278865 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:13.279958 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:13.280390 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:13.319703 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:37:13.330829 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Getting quotas for user cb0e36bf823c4807be33dd2063439ee7 and project c92f56f0006d46078225043f4889d20f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:37:13.404394 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: f7931e04-5470-4acf-bf10-f63bfd460911] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:37:13.412751 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:13.413259 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:13.434444 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] [instance: f7931e04-5470-4acf-bf10-f63bfd460911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:37:13.437356 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:13.438535 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:13.543709 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:13.544005 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc34d01c-bfcb-4faf-a36a-3b67f6273b1c tempest-ServersOnMultiNodesTest-1314600666 tempest-ServersOnMultiNodesTest-1314600666-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:18.852120 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Took 0.95 seconds to select destinations for 3 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:37:18.902408 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:18.904521 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.025894 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.027136 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.110291 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.110970 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.215179 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.215922 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.218667 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.219257 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.265856 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Getting quotas for project dd1a91a325b04d8f9144b4d160cf0f93. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:37:19.277451 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Getting quotas for user fc6da9e43fa348cab744e74f4b1f69f8 and project dd1a91a325b04d8f9144b4d160cf0f93. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:37:19.305216 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] [instance: b3021d28-bc87-48eb-9f9f-92863b0a6f24] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:37:19.312138 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.315160 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.326862 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] [instance: b3021d28-bc87-48eb-9f9f-92863b0a6f24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:37:19.331234 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.333825 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.402495 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.403075 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.428211 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] [instance: 20d47f34-d558-41bd-a77f-b7e97d37c1c8] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:37:19.429227 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.429637 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.449717 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] [instance: 20d47f34-d558-41bd-a77f-b7e97d37c1c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:37:19.451278 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.451713 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.582851 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.583997 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.604425 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] [instance: 5dc100ce-a2e4-49ff-82b6-663d3929fb8e] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:37:19.614559 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.614559 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.703881 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] [instance: 5dc100ce-a2e4-49ff-82b6-663d3929fb8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:37:19.706081 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.707314 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:19.809618 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:19.810027 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d1f4101f-41ab-4bc8-ace2-9b1a91a9ef3c tempest-ListServersNegativeTestJSON-924016468 tempest-ListServersNegativeTestJSON-924016468-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:46.538932 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:37:46.574589 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:46.575575 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:46.661563 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:46.662087 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:46.662881 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:46.663446 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:46.685213 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Getting quotas for project 8cf76f89c7c345a2a5abcd54f300339d. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:37:46.691897 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Getting quotas for user 50ab1f7f5ba94258820f5609a140338c and project 8cf76f89c7c345a2a5abcd54f300339d. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:37:46.711920 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] [instance: f79ca4ee-d575-4570-b3cb-f7aa44f1fd61] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:37:46.712583 n-d-763928-2 nova-conductor[80831]: DEBUG nova.scheduler.utils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-763928-2']) and/or node ([]) {{(pid=80831) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} Apr 30 04:37:46.715009 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:46.715489 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:46.732880 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] [instance: f79ca4ee-d575-4570-b3cb-f7aa44f1fd61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:37:46.734463 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:46.735054 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:37:46.786779 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:37:46.787216 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-30a2c0fd-7c38-433c-8e59-078555580a97 tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:09.678579 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:38:09.716604 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:09.717358 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:09.779373 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:09.786387 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:09.787403 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:09.787969 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:09.804370 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Getting quotas for project 8cf76f89c7c345a2a5abcd54f300339d. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:38:09.809768 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Getting quotas for user 50ab1f7f5ba94258820f5609a140338c and project 8cf76f89c7c345a2a5abcd54f300339d. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:38:09.820538 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] [instance: 4747ac0d-7975-4701-85d8-821c1e367dac] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:38:09.821378 n-d-763928-2 nova-conductor[80830]: DEBUG nova.scheduler.utils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-763928-2']) and/or node ([]) {{(pid=80830) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} Apr 30 04:38:09.823102 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:09.823838 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:09.834387 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] [instance: 4747ac0d-7975-4701-85d8-821c1e367dac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:38:09.836144 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:09.836836 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:09.881789 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:09.883122 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e138d993-9f12-4571-97be-e66e933853fc tempest-TestServerMultinode-1612109882 tempest-TestServerMultinode-1612109882-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:41.826927 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:38:41.856011 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:41.856704 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:41.911919 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:41.912409 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:41.913342 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:41.913738 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:41.939018 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:38:41.945732 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for user bf0693c69c9f47ccaf61c1cc9e2ce367 and project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:38:41.961105 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: 0148ba17-6b7b-4adc-8d8e-f7261302589e] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:38:41.963104 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:41.963685 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:41.974583 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: 0148ba17-6b7b-4adc-8d8e-f7261302589e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:38:41.976714 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:41.978901 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:42.020996 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:42.021501 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-2ce61fcb-bd1c-46bf-bfb3-363121c6a10b tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:50.459794 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:38:50.510209 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:50.510620 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:50.613509 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:50.613918 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:50.614833 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:50.615393 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:50.667246 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Getting quotas for project a9b342bd94a04f50973913b9990663ad. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:38:50.672773 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Getting quotas for user efaf01930cdc47908e183e01e608e934 and project a9b342bd94a04f50973913b9990663ad. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:38:50.711377 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] [instance: 48322a7c-c995-4476-ab2f-2d3d7b24813c] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:38:50.713617 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:50.713900 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:50.733765 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] [instance: 48322a7c-c995-4476-ab2f-2d3d7b24813c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:38:50.735059 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:50.735468 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:38:50.782739 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:38:50.783311 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0d5c9644-7c67-426d-89cd-d2e09e32419f tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:12.500661 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:39:28.313733 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:39:29.331443 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56992. Apr 30 04:39:33.599492 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:39:33.621515 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:33.622160 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:33.672633 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:33.673031 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:33.673743 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:33.674127 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:33.690672 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:39:33.695017 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for user bf0693c69c9f47ccaf61c1cc9e2ce367 and project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:39:33.705588 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: 7bec107c-8f16-434d-aec9-551b52db0240] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:39:33.706532 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:33.707245 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:33.722886 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: 7bec107c-8f16-434d-aec9-551b52db0240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:39:33.724395 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:33.724801 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:33.755526 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:33.756480 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-be45ea87-53b3-49a5-9d64-c6f983c768a8 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:36.334989 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:39:40.593334 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:39:40.615561 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:40.616033 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:40.663136 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:40.663800 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:40.665383 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:40.666702 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:40.685199 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Getting quotas for project a9b342bd94a04f50973913b9990663ad. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:39:40.690281 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Getting quotas for user efaf01930cdc47908e183e01e608e934 and project a9b342bd94a04f50973913b9990663ad. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:39:40.702555 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] [instance: 30268426-0871-4731-8782-693a8e9f9cf8] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:39:40.703669 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:40.704057 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:40.715497 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] [instance: 30268426-0871-4731-8782-693a8e9f9cf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:39:40.716753 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:40.717370 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:40.759474 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:39:40.760240 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b2b7c582-03d9-40f7-a92a-4217f3553fa4 tempest-ServerRescueTestJSON-1220809842 tempest-ServerRescueTestJSON-1220809842-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:39:52.310340 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 04:39:53.340202 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57404. Apr 30 04:40:50.904482 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:40:50.935982 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:40:50.936543 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:40:50.995589 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:40:50.996093 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:40:50.997024 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:40:50.997511 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:40:51.015994 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Getting quotas for project 56ea904ea1b14e91b843c0dbda1e353f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:40:51.021482 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Getting quotas for user e07d817613bf49c5a87df606e0c4d8d4 and project 56ea904ea1b14e91b843c0dbda1e353f. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:40:51.051604 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] [instance: 03e95c52-c546-4d08-a1d2-91d39c59bc67] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:40:51.052952 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:40:51.053518 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:40:51.072397 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] [instance: 03e95c52-c546-4d08-a1d2-91d39c59bc67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:40:51.074269 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:40:51.074728 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:40:51.106577 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:40:51.106988 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bc19a286-54d3-4947-8c76-ee23c411a954 tempest-ServerTagsTestJSON-884378365 tempest-ServerTagsTestJSON-884378365-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:19.895197 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:41:19.917272 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:19.917773 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:19.981762 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:19.982185 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:19.983086 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:19.983714 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:20.000132 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Getting quotas for project 26a74b4b3a394a0d9fae2f0f0b594d8b. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:41:20.005122 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Getting quotas for user 7fe0e5d030f044e4965dd027785d285d and project 26a74b4b3a394a0d9fae2f0f0b594d8b. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:41:20.016984 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] [instance: f4fe4afb-1cf2-4b2d-91c0-a789e664c12f] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:41:20.017860 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:20.018271 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:20.026349 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] [instance: f4fe4afb-1cf2-4b2d-91c0-a789e664c12f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:41:20.027591 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:20.028000 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:20.058050 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:20.058498 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9d3f4652-05f1-4911-9d61-af865ac2dd19 tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:26.957066 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:41:26.981668 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:26.982082 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:27.030633 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:27.031260 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:27.032225 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:27.032795 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:27.051041 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:41:27.057076 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for user bf0693c69c9f47ccaf61c1cc9e2ce367 and project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:41:27.077457 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: a4b0e10f-e8a9-46c6-bee0-3f6aa8ea0e6e] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:41:27.079855 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:27.080346 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:27.088735 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: a4b0e10f-e8a9-46c6-bee0-3f6aa8ea0e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:41:27.090200 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:27.091300 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:27.132662 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:27.133261 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0ba61191-1a1a-435c-b7bf-c187f2b81b62 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:36.076239 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:41:36.102981 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:36.103672 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:36.156493 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:36.157557 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:36.160400 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:36.161060 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:36.188352 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Getting quotas for project 26a74b4b3a394a0d9fae2f0f0b594d8b. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:41:36.194913 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Getting quotas for user 7fe0e5d030f044e4965dd027785d285d and project 26a74b4b3a394a0d9fae2f0f0b594d8b. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:41:36.207969 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] [instance: 48c20129-f188-4838-88d5-4ac2bc38df73] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:41:36.209187 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:36.210289 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:36.220207 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] [instance: 48c20129-f188-4838-88d5-4ac2bc38df73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:41:36.222006 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:36.222723 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:36.274153 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:36.274540 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-32b53413-7aa0-4d73-870b-c30adbdc37cd tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:47.061870 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:41:47.090429 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:47.090918 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:47.148883 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:47.149856 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:47.151361 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:47.151928 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:47.170842 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:41:47.175597 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Getting quotas for user bf0693c69c9f47ccaf61c1cc9e2ce367 and project fd1f59f4bd99439b8c8d364b155eb058. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:41:47.187726 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: f057990a-409f-4060-a387-ccb46f0f678d] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:41:47.189057 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:47.189647 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:47.198488 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] [instance: f057990a-409f-4060-a387-ccb46f0f678d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:41:47.201054 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:47.202921 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:41:47.259162 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:41:47.259872 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c2aae24a-5ef8-4fe5-b1cf-0a1962413313 tempest-ServerActionsTestJSON-281962406 tempest-ServerActionsTestJSON-281962406-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:42:29.334291 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 04:42:30.354995 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33596. Apr 30 04:42:32.518761 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:42:53.333710 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 04:42:54.361111 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34100. Apr 30 04:42:56.368556 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:43:43.034352 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-aca10a53-6c52-48d5-b9b4-a1ca0c33600f tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method unshelve_instance {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:43:43.034870 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-aca10a53-6c52-48d5-b9b4-a1ca0c33600f tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:43:43.035591 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-aca10a53-6c52-48d5-b9b4-a1ca0c33600f tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:43:43.726240 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-aca10a53-6c52-48d5-b9b4-a1ca0c33600f tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] [instance: f4fe4afb-1cf2-4b2d-91c0-a789e664c12f] Requesting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) during scheduling {{(pid=80830) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 30 04:43:44.178602 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-aca10a53-6c52-48d5-b9b4-a1ca0c33600f tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:43:44.213768 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-aca10a53-6c52-48d5-b9b4-a1ca0c33600f tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Lazy-loading 'flavor' on Instance uuid f4fe4afb-1cf2-4b2d-91c0-a789e664c12f {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:43:44.502913 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_db.api [None req-aca10a53-6c52-48d5-b9b4-a1ca0c33600f tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Apr 30 04:43:44.502913 n-d-763928-2 nova-conductor[80830]: [SQL: UPDATE instance_actions SET updated_at=%(updated_at)s WHERE instance_actions.id = %(instance_actions_id)s] Apr 30 04:43:44.502913 n-d-763928-2 nova-conductor[80830]: [parameters: {'updated_at': datetime.datetime(2021, 4, 30, 4, 43, 44, 473711), 'instance_actions_id': 300}] Apr 30 04:43:44.502913 n-d-763928-2 nova-conductor[80830]: (Background on this error at: http://sqlalche.me/e/13/e3q8) {{(pid=80830) _is_exception_expected /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:184}} Apr 30 04:43:44.506808 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_db.api [None req-aca10a53-6c52-48d5-b9b4-a1ca0c33600f tempest-ServersNegativeTestJSON-953849405 tempest-ServersNegativeTestJSON-953849405-project] Performing DB retry for function nova.db.sqlalchemy.api.action_event_finish {{(pid=80830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Apr 30 04:43:55.064595 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:43:56.096582 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 35062. Apr 30 04:43:58.647209 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:43:58.649115 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:43:58.706046 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] [a43233a9-c8af-4fca-88e5-cbff411f85b4] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 04:43:59.736707 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] [a43233a9-c8af-4fca-88e5-cbff411f85b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 35126. Apr 30 04:44:00.131253 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Took 1.43 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:44:00.166016 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:00.166571 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:00.243800 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:00.247884 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:00.249183 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:00.249852 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:00.290148 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Getting quotas for project 65b80515a9ee4f308a3950cbd339bd5b. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:44:00.298179 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Getting quotas for user 11d75105ab32433895b5532d5ed07229 and project 65b80515a9ee4f308a3950cbd339bd5b. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:44:00.313900 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] [instance: becadca2-a298-486a-a029-09026a2f21c3] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:44:00.315218 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:00.315811 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:00.327538 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] [instance: becadca2-a298-486a-a029-09026a2f21c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:44:00.328736 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:00.329176 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:00.363702 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:00.364112 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:00.373726 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] [2bff9143-2072-410b-8585-fa088e769924] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 04:44:01.395057 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [None req-86c9043e-ad12-4695-9313-9838376bd43b tempest-ServerGroupTestJSON-301974401 tempest-ServerGroupTestJSON-301974401-project] [2bff9143-2072-410b-8585-fa088e769924] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 35158. Apr 30 04:44:02.252806 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:44:02.314108 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:02.314920 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:02.390098 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:02.390551 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:02.391810 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:02.392216 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:02.413794 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Getting quotas for project b4255d6d5336454cbf4bf8600e7b11cd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:44:02.418912 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Getting quotas for user 836f4da9ff7748e5b54333f83bb2bf67 and project b4255d6d5336454cbf4bf8600e7b11cd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:44:02.431460 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] [instance: 61eb827b-5312-436d-b9a9-085225c92b27] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:44:02.432761 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:02.433456 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:02.450121 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] [instance: 61eb827b-5312-436d-b9a9-085225c92b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:44:02.452079 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:02.452709 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:02.512791 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:02.513214 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-16adb522-b6c4-415d-b50d-0d0500b1f970 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:38.058746 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:44:38.089037 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:38.089717 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:38.154478 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:38.154884 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:38.155616 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:38.156010 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:38.179456 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Getting quotas for project c8e30acc97154d519a27ee64060f8a62. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:44:38.186084 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Getting quotas for user eeda2b4e9d58425894d17fe8fabc9678 and project c8e30acc97154d519a27ee64060f8a62. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:44:38.201922 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] [instance: a3d1498f-6551-48ae-abb0-edacc6391aad] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:44:38.203397 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:38.204032 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:38.213834 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] [instance: a3d1498f-6551-48ae-abb0-edacc6391aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:44:38.215473 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:38.216306 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:38.264216 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:38.265155 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-0fa8a58a-49f9-4613-bf54-6b29da48411a tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:43.997071 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:44:44.022363 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:44.022771 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:44.076272 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:44.076628 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:44.077396 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:44.077792 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:44.098759 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Getting quotas for project 40d443b0529a4a4890d0e71fb45baf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:44:44.104586 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Getting quotas for user 8a2478731f704f13853ea6dc1025af6d and project 40d443b0529a4a4890d0e71fb45baf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:44:44.121191 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] [instance: 2748f56a-8cb1-463e-84d2-2c20f5b65c17] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:44:44.122713 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:44.123388 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:44.135220 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] [instance: 2748f56a-8cb1-463e-84d2-2c20f5b65c17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:44:44.137183 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:44.137754 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:44:44.173623 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:44:44.174139 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6669bcfb-cb91-4820-968e-5c9c131fcf29 tempest-ServersNegativeTestMultiTenantJSON-1062947566 tempest-ServersNegativeTestMultiTenantJSON-1062947566-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:00.271001 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-059269ec-50a0-4d1c-9035-ea1ccd0e2a20 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:45:00.273153 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-059269ec-50a0-4d1c-9035-ea1ccd0e2a20 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:00.273652 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-059269ec-50a0-4d1c-9035-ea1ccd0e2a20 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:00.745971 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-059269ec-50a0-4d1c-9035-ea1ccd0e2a20 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] [instance: 61eb827b-5312-436d-b9a9-085225c92b27] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 04:45:01.355040 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-059269ec-50a0-4d1c-9035-ea1ccd0e2a20 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Created allocations for migration 1df04842-ad13-4a8d-95c9-8bc59248f023 on 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:45:01.682408 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-059269ec-50a0-4d1c-9035-ea1ccd0e2a20 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] [instance: 61eb827b-5312-436d-b9a9-085225c92b27] Calling prep_resize with selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 04:45:09.504475 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:45:09.532624 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:09.533465 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:09.606742 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:09.607381 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:09.608645 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:09.608963 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:09.628522 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Getting quotas for project 2e1a34b8cd3048aba8fca1d84e3339cc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:45:09.633546 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Getting quotas for user b45127029c344301bd872f3e67d0bda7 and project 2e1a34b8cd3048aba8fca1d84e3339cc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:45:09.646489 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] [instance: f25f675e-fe14-403b-9cb6-725adb40557a] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:45:09.647747 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:09.648157 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:09.665099 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] [instance: f25f675e-fe14-403b-9cb6-725adb40557a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:45:09.666553 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:09.667090 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:09.726424 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:09.727058 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c91d33f2-5253-429b-8651-c9e33230a60f tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:24.107485 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:45:24.171130 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:24.171868 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:24.232737 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:24.233337 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:24.234275 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:24.234839 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:24.252984 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Getting quotas for project 5c65d2981bf54d43b4f3ec7e943a7d51. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:45:24.260655 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Getting quotas for user 60b7e4b874f44e2f9adb22efc6a4779c and project 5c65d2981bf54d43b4f3ec7e943a7d51. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:45:24.288175 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] [instance: 34ca200a-6823-4549-8918-6ef2a7d87f4a] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:45:24.289865 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:24.295170 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:24.303682 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] [instance: 34ca200a-6823-4549-8918-6ef2a7d87f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:45:24.305100 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:24.305612 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:24.334245 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:24.334996 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8b36ae4-4d65-4e3d-a7eb-140e131ff856 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:30.361597 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:45:31.393699 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37160. Apr 30 04:45:42.421708 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:45:42.446192 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:42.446595 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:42.517935 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:42.518442 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:42.519337 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:42.519733 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:42.540565 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Getting quotas for project 84c103a709f149a3b9677594275dfb88. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:45:42.545606 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Getting quotas for user fc5e44a9c2d942d8802aa2a3a9f2ce93 and project 84c103a709f149a3b9677594275dfb88. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:45:42.558081 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] [instance: 69e01c65-97a6-4f8c-b2c5-886709fb5a40] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:45:42.559402 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:42.560048 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:42.567621 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] [instance: 69e01c65-97a6-4f8c-b2c5-886709fb5a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:45:42.569578 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:42.571417 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:42.624129 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:45:42.624649 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-2b9c4140-cc32-4740-a61a-7ccae8d99dc9 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:45:52.552799 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:45:54.358986 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:45:55.379786 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37910. Apr 30 04:46:01.440271 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:46:01.473177 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:01.473929 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:01.530487 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:01.530890 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:01.531731 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:01.532978 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:01.553272 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Getting quotas for project 5c65d2981bf54d43b4f3ec7e943a7d51. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:46:01.559618 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Getting quotas for user 60b7e4b874f44e2f9adb22efc6a4779c and project 5c65d2981bf54d43b4f3ec7e943a7d51. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:46:01.574579 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] [instance: 79da0348-c2d1-4b71-9106-1613f37605da] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:46:01.575639 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:01.576095 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:01.584910 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] [instance: 79da0348-c2d1-4b71-9106-1613f37605da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:46:01.586492 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:01.586952 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:01.618945 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:01.619785 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-ac24876e-072b-433c-9a87-f70a118bf242 tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:16.402466 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:46:26.237093 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:46:26.267300 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:26.267924 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:26.326743 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:26.327155 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:26.327918 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:26.329032 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:26.347139 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Getting quotas for project 5c65d2981bf54d43b4f3ec7e943a7d51. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:46:26.351644 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Getting quotas for user 60b7e4b874f44e2f9adb22efc6a4779c and project 5c65d2981bf54d43b4f3ec7e943a7d51. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:46:26.362541 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] [instance: 73b35909-79e1-4736-a88f-a3921e76629c] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:46:26.363425 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:26.363835 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:26.370753 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] [instance: 73b35909-79e1-4736-a88f-a3921e76629c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:46:26.372049 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:26.372481 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:26.409018 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:26.409670 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-44cf3e18-3c0a-4341-97c7-b8f14a1b4b2e tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:29.405498 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:46:29.439792 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:29.440630 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:29.527513 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:29.529385 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:29.530830 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:29.531630 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:29.575200 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Getting quotas for project 33ae4b4b48a3424392f743c961848d1c. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:46:29.588394 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Getting quotas for user daa9d08d051246899f896fa37c037a6d and project 33ae4b4b48a3424392f743c961848d1c. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:46:29.615885 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] [instance: 72ea4b96-75af-4490-a369-eb61e4f2e809] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:46:29.618372 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:29.619815 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:29.636537 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] [instance: 72ea4b96-75af-4490-a369-eb61e4f2e809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:46:29.638195 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:29.638802 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:29.693979 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:29.694388 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4232a1f8-2fa2-4193-a7c4-78b68a061883 tempest-InstanceActionsNegativeTestJSON-1198793210 tempest-InstanceActionsNegativeTestJSON-1198793210-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:32.138135 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:46:32.176207 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:32.177249 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:32.239462 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:32.240162 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:32.241634 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:32.242200 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:32.261970 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Getting quotas for project b4255d6d5336454cbf4bf8600e7b11cd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:46:32.267322 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Getting quotas for user 836f4da9ff7748e5b54333f83bb2bf67 and project b4255d6d5336454cbf4bf8600e7b11cd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:46:32.278635 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] [instance: e9244f88-2ee5-49b4-9f69-fd481ecf4d75] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:46:32.279645 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:32.280404 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:32.292993 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] [instance: e9244f88-2ee5-49b4-9f69-fd481ecf4d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:46:32.294820 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:32.295423 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:32.332452 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:32.334193 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-625d16f4-8e5f-4b1e-9c24-6ddcb384ab37 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:55.739934 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Took 0.31 seconds to select destinations for 2 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:46:55.762974 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:55.763390 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:55.822454 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:55.822549 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:55.875402 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:55.875857 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:55.876996 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:55.877548 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:55.899297 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Getting quotas for project 92cfc00378404189b703c373671247da. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:46:55.912221 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Getting quotas for user 3b74821611ef4b40841f7532d8b43aa7 and project 92cfc00378404189b703c373671247da. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:46:55.926890 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] [instance: 09be96ea-f9f9-4bd7-bd4d-53401c8b7acb] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:46:55.928210 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:55.928887 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:55.938467 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] [instance: 09be96ea-f9f9-4bd7-bd4d-53401c8b7acb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:46:55.939698 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:55.940239 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:55.971865 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:55.972356 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:55.982750 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] [instance: 7743bf5d-1335-4455-bf3b-bd74cfcd3ee1] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:46:55.984093 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:55.984740 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:55.992554 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] [instance: 7743bf5d-1335-4455-bf3b-bd74cfcd3ee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:46:55.993824 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:55.994246 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:46:56.037091 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:46:56.037896 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-aecc6f89-5143-48fe-b069-79ec6bfa46b3 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:04.321337 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:47:04.344394 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:04.344952 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:04.391526 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:04.392054 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:04.392817 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:04.393212 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:04.409678 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Getting quotas for project 5c65d2981bf54d43b4f3ec7e943a7d51. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:47:04.414278 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Getting quotas for user 60b7e4b874f44e2f9adb22efc6a4779c and project 5c65d2981bf54d43b4f3ec7e943a7d51. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:47:04.426200 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] [instance: 4b8291fb-3965-403d-840b-39830988ce5d] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:47:04.427147 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:04.427545 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:04.434300 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] [instance: 4b8291fb-3965-403d-840b-39830988ce5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:47:04.435655 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:04.436035 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:04.466277 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:04.466741 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b6077ef5-64b2-450b-9201-94b4a902111c tempest-AttachVolumeNegativeTest-179407354 tempest-AttachVolumeNegativeTest-179407354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:06.316924 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:47:06.339938 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:06.340364 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:06.389093 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:06.389689 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:06.390488 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:06.390914 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:06.407921 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Getting quotas for project 84c103a709f149a3b9677594275dfb88. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:47:06.412615 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Getting quotas for user fc5e44a9c2d942d8802aa2a3a9f2ce93 and project 84c103a709f149a3b9677594275dfb88. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:47:06.423798 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] [instance: 9996b12a-a504-4b74-b8fd-49070b23fb39] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:47:06.424774 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:06.425171 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:06.432148 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] [instance: 9996b12a-a504-4b74-b8fd-49070b23fb39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:47:06.433447 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:06.434118 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:06.465341 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:06.465960 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bcba1e0b-7160-4f43-8538-2b1a5974f814 tempest-VolumesSnapshotTestJSON-395155045 tempest-VolumesSnapshotTestJSON-395155045-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:15.677651 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Took 0.38 seconds to select destinations for 2 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:47:15.711535 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:15.712389 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:15.778459 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:15.779781 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:15.838655 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:15.839413 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:15.840239 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:15.841117 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:15.864879 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Getting quotas for project 92cfc00378404189b703c373671247da. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:47:15.870098 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Getting quotas for user 3b74821611ef4b40841f7532d8b43aa7 and project 92cfc00378404189b703c373671247da. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:47:15.885338 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] [instance: 7050e486-cefe-4554-9958-1be52113aac3] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:47:15.886785 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:15.887953 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:15.899152 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] [instance: 7050e486-cefe-4554-9958-1be52113aac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:47:15.901625 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:15.902571 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:15.954434 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:15.955350 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:15.980795 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] [instance: f9b4dfcf-4f9e-49f7-9aad-72e080609f76] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:47:15.983287 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:15.983880 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:15.993499 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] [instance: f9b4dfcf-4f9e-49f7-9aad-72e080609f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:47:15.995925 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:15.996580 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:16.051804 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:16.052498 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9fae8a3c-093a-4346-8e7a-b7c956a9ecd9 tempest-MultipleCreateTestJSON-147709197 tempest-MultipleCreateTestJSON-147709197-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:27.048930 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b8abfd84-bba7-464a-a016-55fb53905e93 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:47:27.049890 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b8abfd84-bba7-464a-a016-55fb53905e93 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:27.050336 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b8abfd84-bba7-464a-a016-55fb53905e93 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:27.568782 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-b8abfd84-bba7-464a-a016-55fb53905e93 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] [instance: e9244f88-2ee5-49b4-9f69-fd481ecf4d75] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 04:47:28.176642 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-b8abfd84-bba7-464a-a016-55fb53905e93 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Created allocations for migration fd453f40-7bdd-4c35-8599-78326915adc0 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:47:28.520149 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-b8abfd84-bba7-464a-a016-55fb53905e93 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] [instance: e9244f88-2ee5-49b4-9f69-fd481ecf4d75] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 04:47:42.115596 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-cbfdc0bf-1dd6-4e0b-b545-bf7c6339fd65 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method unshelve_instance {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:47:42.117312 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cbfdc0bf-1dd6-4e0b-b545-bf7c6339fd65 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:42.117312 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cbfdc0bf-1dd6-4e0b-b545-bf7c6339fd65 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:42.784356 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-cbfdc0bf-1dd6-4e0b-b545-bf7c6339fd65 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] [instance: f25f675e-fe14-403b-9cb6-725adb40557a] Requesting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) during scheduling {{(pid=80830) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 30 04:47:43.115533 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-cbfdc0bf-1dd6-4e0b-b545-bf7c6339fd65 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:47:43.127520 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-cbfdc0bf-1dd6-4e0b-b545-bf7c6339fd65 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lazy-loading 'flavor' on Instance uuid f25f675e-fe14-403b-9cb6-725adb40557a {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:47:44.328667 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:47:44.361126 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:44.361812 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:44.431717 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:44.432148 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:44.432926 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:44.433320 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:44.453991 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Getting quotas for project d742dfb7fe25460c8da3fe939c7f6c11. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:47:44.477427 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Getting quotas for user 54f1f676284f40cbb5e55f83e64188db and project d742dfb7fe25460c8da3fe939c7f6c11. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:47:44.537248 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] [instance: 6fe280f1-9325-4d19-884f-623b1c489c5b] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:47:44.539685 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:44.540245 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:44.552586 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] [instance: 6fe280f1-9325-4d19-884f-623b1c489c5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:47:44.554764 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:44.555470 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:47:44.612159 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:47:44.613596 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-088bc338-8023-4020-aa2b-1e8771928f5c tempest-ServerMetadataNegativeTestJSON-2133569387 tempest-ServerMetadataNegativeTestJSON-2133569387-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:26.349235 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:48:26.380837 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:26.382354 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:26.491291 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:26.491817 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:26.492605 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:26.493001 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:26.512533 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Getting quotas for project da83acaf20984491ac4c2305c36a4c83. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:48:26.517568 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Getting quotas for user c997512a43d74ee1afd0f5d01fbc55d2 and project da83acaf20984491ac4c2305c36a4c83. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:48:26.529656 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] [instance: e30157e1-fe2e-4fe5-8ccb-5ce3726ca7cb] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:48:26.530706 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:26.531325 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:26.541523 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] [instance: e30157e1-fe2e-4fe5-8ccb-5ce3726ca7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:48:26.545701 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:26.546363 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:26.606607 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:26.607471 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-dec8004d-6fb2-430e-ad7b-8c52f294a04f tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:28.340394 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:48:28.392107 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:28.392631 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:28.472451 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:28.472764 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:28.481632 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:28.485978 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:28.513851 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Getting quotas for project da83acaf20984491ac4c2305c36a4c83. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:48:28.538035 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Getting quotas for user c997512a43d74ee1afd0f5d01fbc55d2 and project da83acaf20984491ac4c2305c36a4c83. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:48:28.551723 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] [instance: e88e0f29-dd8b-4968-b6d3-984708d515b5] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:48:28.552699 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:28.553101 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:28.564136 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] [instance: e88e0f29-dd8b-4968-b6d3-984708d515b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:48:28.572139 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:28.572139 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:28.628852 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:48:28.629215 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5789bd21-498a-4881-aafc-3ea09975f036 tempest-ServerRescueNegativeTestJSON-1420765438 tempest-ServerRescueNegativeTestJSON-1420765438-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:48:31.391811 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 04:48:32.414897 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40144. Apr 30 04:48:55.378766 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 04:48:56.425876 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40770. Apr 30 04:49:05.795778 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:49:05.833334 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:05.834175 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:05.985739 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:05.988976 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:05.988976 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:05.988976 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:06.049278 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Getting quotas for project c8e30acc97154d519a27ee64060f8a62. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:49:06.054767 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Getting quotas for user eeda2b4e9d58425894d17fe8fabc9678 and project c8e30acc97154d519a27ee64060f8a62. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:49:06.090059 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] [instance: dddf38d2-bafc-4a6f-808a-952a9329410b] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:49:06.092841 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:06.093478 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:06.104810 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] [instance: dddf38d2-bafc-4a6f-808a-952a9329410b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:49:06.109192 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:06.113776 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:06.187937 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:06.188905 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-b06345d0-cd4f-414b-9dfb-fc0ebfdd5961 tempest-AttachVolumeTestJSON-1094123535 tempest-AttachVolumeTestJSON-1094123535-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:12.573824 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:49:17.817413 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:49:17.856560 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:17.856974 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:17.921507 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:17.922300 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:17.925023 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:17.925782 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:17.945237 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Getting quotas for project b4255d6d5336454cbf4bf8600e7b11cd. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:49:17.951180 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Getting quotas for user 836f4da9ff7748e5b54333f83bb2bf67 and project b4255d6d5336454cbf4bf8600e7b11cd. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:49:17.965889 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] [instance: 94f02e1d-3793-453b-858b-b480f6ba3e6e] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:49:17.967333 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:17.967967 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:17.985365 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] [instance: 94f02e1d-3793-453b-858b-b480f6ba3e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:49:17.986630 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:17.987033 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:18.031293 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:18.032075 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-a189539c-7316-4d33-88c7-d3d2f3388888 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:21.561717 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:49:21.588392 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:21.589170 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:21.642328 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:21.642991 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:21.643942 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:21.644572 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:21.662129 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Getting quotas for project 2e1a34b8cd3048aba8fca1d84e3339cc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:49:21.667648 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Getting quotas for user b45127029c344301bd872f3e67d0bda7 and project 2e1a34b8cd3048aba8fca1d84e3339cc. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:49:21.679222 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] [instance: c537397e-d98a-495b-8b9d-6deb30704564] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:49:21.680743 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:21.681505 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:21.697173 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] [instance: c537397e-d98a-495b-8b9d-6deb30704564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:49:21.698837 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:21.699244 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:21.743332 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:21.744235 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-fd2fa092-9a03-4049-a299-88a28fae1ec6 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:36.424337 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:49:40.486680 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:49:40.540831 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:40.541850 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:40.607551 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:40.608346 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:40.610653 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:40.611344 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:40.637947 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Getting quotas for project a302b89e39ea47d699a9be34a944788a. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:49:40.644418 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Getting quotas for user dcc23979654942ffaa707795aa744d5a and project a302b89e39ea47d699a9be34a944788a. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:49:40.658368 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] [instance: 57ae4cf4-6290-42be-b7b8-5a7c349771dc] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:49:40.659581 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:40.660183 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:40.669787 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] [instance: 57ae4cf4-6290-42be-b7b8-5a7c349771dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:49:40.671624 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:40.672375 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:49:40.706119 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:49:40.707132 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-36ac0ea0-f487-466d-ad55-035588dd0749 tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:50:10.837303 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-e31b72a3-a2c1-4f9f-897a-db62353c0481 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:50:10.837924 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e31b72a3-a2c1-4f9f-897a-db62353c0481 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:50:10.838163 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e31b72a3-a2c1-4f9f-897a-db62353c0481 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:50:11.207158 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-e31b72a3-a2c1-4f9f-897a-db62353c0481 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Created allocations for migration 5f9d9559-bace-4133-bcff-42953d65630d on 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 04:50:11.479214 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.live_migrate [None req-e31b72a3-a2c1-4f9f-897a-db62353c0481 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] [instance: 94f02e1d-3793-453b-858b-b480f6ba3e6e] Requesting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while live migrating {{(pid=80830) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}} Apr 30 04:50:11.701328 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-e31b72a3-a2c1-4f9f-897a-db62353c0481 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Lazy-loading 'resources' on Instance uuid 94f02e1d-3793-453b-858b-b480f6ba3e6e {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:50:11.705516 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-e31b72a3-a2c1-4f9f-897a-db62353c0481 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] Lazy-loading 'pci_requests' on Instance uuid 94f02e1d-3793-453b-858b-b480f6ba3e6e {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:50:12.089239 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.live_migrate [None req-e31b72a3-a2c1-4f9f-897a-db62353c0481 tempest-TestNetworkAdvancedServerOps-1633835467 tempest-TestNetworkAdvancedServerOps-1633835467-project-admin] [instance: 94f02e1d-3793-453b-858b-b480f6ba3e6e] Start binding ports on destination host: n-h2-763928-2 {{(pid=80830) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 30 04:50:53.407563 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:50:53.448090 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:50:53.450631 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:50:53.551925 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:50:53.553019 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:50:53.554076 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:50:53.554641 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:50:53.589834 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Getting quotas for project a302b89e39ea47d699a9be34a944788a. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:50:53.594828 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Getting quotas for user dcc23979654942ffaa707795aa744d5a and project a302b89e39ea47d699a9be34a944788a. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:50:53.606455 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] [instance: fb064bab-8b00-46ae-afdc-a7ca3acda87e] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:50:53.608007 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:50:53.608682 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:50:53.618513 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] [instance: fb064bab-8b00-46ae-afdc-a7ca3acda87e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:50:53.620346 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:50:53.621141 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:50:53.655992 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:50:53.657239 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c16258d7-b208-4e1b-a330-4257a338b05f tempest-TestSecurityGroupsBasicOps-267266635 tempest-TestSecurityGroupsBasicOps-267266635-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:51:12.696004 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:51:12.760029 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:51:12.760793 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:51:12.844590 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:51:12.844990 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:51:12.845707 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:51:12.846092 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:51:12.883669 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Getting quotas for project b4255d6d5336454cbf4bf8600e7b11cd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:51:12.902993 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Getting quotas for user 836f4da9ff7748e5b54333f83bb2bf67 and project b4255d6d5336454cbf4bf8600e7b11cd. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:51:12.945046 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] [instance: 8fb5f771-a91e-4f6b-9752-d83ef6a8e2a0] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:51:12.946872 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:51:12.947288 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:51:12.961352 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] [instance: 8fb5f771-a91e-4f6b-9752-d83ef6a8e2a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:51:12.962991 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:51:12.963673 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:51:13.012628 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:51:13.013103 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-0eb4bc51-e0f0-4044-87ab-97026944197a tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:51:56.458827 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 04:51:57.491507 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43738. Apr 30 04:52:14.102888 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-49cef5d8-d071-4a93-ac42-5859aa40ba25 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method rebuild_instance {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:52:14.103961 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-49cef5d8-d071-4a93-ac42-5859aa40ba25 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:52:14.105660 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-49cef5d8-d071-4a93-ac42-5859aa40ba25 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:52:14.141383 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-49cef5d8-d071-4a93-ac42-5859aa40ba25 tempest-TestNetworkAdvancedServerOps-760093627 tempest-TestNetworkAdvancedServerOps-760093627-project] [instance: 8fb5f771-a91e-4f6b-9752-d83ef6a8e2a0] No migration record for the rebuild/evacuate request. {{(pid=80831) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 30 04:52:15.697051 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f1268546-9d9b-4cbc-965f-0c4e356d6ad8 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method unshelve_instance {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 04:52:15.698704 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f1268546-9d9b-4cbc-965f-0c4e356d6ad8 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:52:15.700093 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-f1268546-9d9b-4cbc-965f-0c4e356d6ad8 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:52:16.171531 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f1268546-9d9b-4cbc-965f-0c4e356d6ad8 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] [instance: c537397e-d98a-495b-8b9d-6deb30704564] Requesting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) during scheduling {{(pid=80830) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 30 04:52:16.489893 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-f1268546-9d9b-4cbc-965f-0c4e356d6ad8 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:52:16.502681 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-f1268546-9d9b-4cbc-965f-0c4e356d6ad8 tempest-AttachVolumeShelveTestJSON-1660656776 tempest-AttachVolumeShelveTestJSON-1660656776-project] Lazy-loading 'flavor' on Instance uuid c537397e-d98a-495b-8b9d-6deb30704564 {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 04:52:32.414812 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:52:32.595729 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:52:33.434026 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44440. Apr 30 04:52:56.104545 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:52:57.130420 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45182. Apr 30 04:53:46.451372 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:53:46.479760 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:53:46.480567 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:53:46.557739 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:53:46.558247 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:53:46.559248 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:53:46.559872 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:53:46.585713 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Getting quotas for project fda82061b01c4912afd97e349ca964ad. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:53:46.595487 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Getting quotas for user e929649e56ad48b5b7ea763b0b61c6d9 and project fda82061b01c4912afd97e349ca964ad. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:53:46.616138 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] [instance: e0790064-fa11-4e0d-b9e0-fefc29bdb938] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:53:46.617580 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:53:46.618302 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:53:46.627168 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] [instance: e0790064-fa11-4e0d-b9e0-fefc29bdb938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:53:46.629218 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:53:46.629906 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:53:46.678971 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:53:46.679847 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-41182607-0528-43e7-b153-e6b060692b18 tempest-TestServerAdvancedOps-434673500 tempest-TestServerAdvancedOps-434673500-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:54:36.448788 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:54:57.488293 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 04:54:58.524340 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48230. Apr 30 04:55:04.754663 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:55:05.775839 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48402. Apr 30 04:55:09.890810 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:55:10.924973 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48514. Apr 30 04:55:33.435614 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:55:34.455371 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48916. Apr 30 04:55:52.616397 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:55:57.131355 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:55:58.150840 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49360. Apr 30 04:56:09.879857 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:56:10.909571 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49508. Apr 30 04:56:15.105019 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:56:16.937345 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:56:21.418283 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Took 1.06 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:56:21.440891 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:56:21.441519 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:56:21.503418 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:56:21.504185 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:56:21.505656 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:56:21.506288 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:56:21.530362 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Getting quotas for project df3c9dbacfd04b9fbda6e7c0d47b2f77. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:56:21.538533 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Getting quotas for user 28296d44392b453683dc960cbdda6dc5 and project df3c9dbacfd04b9fbda6e7c0d47b2f77. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:56:21.552380 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] [instance: 210a8c59-e223-45db-aaac-5bee36353b4b] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:56:21.553804 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:56:21.554385 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:56:21.565110 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] [instance: 210a8c59-e223-45db-aaac-5bee36353b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:56:21.566967 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:56:21.567626 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:56:21.671994 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:56:21.672428 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-9b74cb4f-444a-4682-a159-7979a8aa9ed8 tempest-VolumesNegativeTest-1721748775 tempest-VolumesNegativeTest-1721748775-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:57:56.475163 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 04:57:58.526115 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 04:57:59.548478 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52402. Apr 30 04:58:22.036267 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 04:58:22.087790 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:58:22.088193 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:58:22.169387 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:58:22.170230 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:58:22.171442 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:58:22.172134 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:58:22.191477 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Getting quotas for project 085134bd6dc74e56ae599be6e442c5fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 04:58:22.200035 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Getting quotas for user 155dd07a58c342b7a18f4deddf70b98f and project 085134bd6dc74e56ae599be6e442c5fc. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 04:58:22.229715 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] [instance: ea37c50f-b580-4af1-8484-db9000f3cb0a] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 04:58:22.234422 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:58:22.235153 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:58:22.280067 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] [instance: ea37c50f-b580-4af1-8484-db9000f3cb0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 04:58:22.280067 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:58:22.280067 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:58:22.323503 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 04:58:22.324507 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d54004aa-a6a5-4268-93db-a698659318f9 tempest-VolumesActionsTest-343537163 tempest-VolumesActionsTest-343537163-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 04:58:34.454682 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:58:35.489816 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53400. Apr 30 04:59:05.778348 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:59:06.810281 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54534. Apr 30 04:59:10.915419 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 04:59:11.952730 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54620. Apr 30 04:59:12.646470 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:00:02.868118 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:00:02.901027 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:02.902083 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:02.967560 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:02.967767 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:02.968508 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:02.969755 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:02.987471 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Getting quotas for project ecd452eff64c439f8faaa1959060cf6a. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:00:02.992524 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Getting quotas for user 18ff6c64a9634722b30ec2e72b56aa93 and project ecd452eff64c439f8faaa1959060cf6a. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:00:03.005866 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] [instance: a61f97ed-7bca-456c-a27e-cf0cb21ee76f] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:00:03.006903 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:03.007377 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:03.017611 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] [instance: a61f97ed-7bca-456c-a27e-cf0cb21ee76f] block_device_mapping [BlockDeviceMapping(attachment_id=0589d27c-806c-4df7-9e6e-4d48b80b952f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1f4b504-a4c8-449f-b270-e7066df787ce',volume_size=1,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:00:03.019033 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:03.019529 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:03.066725 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:03.067535 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6a43e613-c7c6-4612-8d91-661bb1a8e4fb tempest-TestVolumeBackupRestore-1909667030 tempest-TestVolumeBackupRestore-1909667030-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:20.976590 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:00:20.999526 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:21.000208 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:21.052426 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:21.052833 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:21.053656 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:21.054053 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:21.070447 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Getting quotas for project b96ac253f1c7428391b40f8f9806d531. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:00:21.076647 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Getting quotas for user 4274293a3d7d4cfa9cfcf684ce8605b7 and project b96ac253f1c7428391b40f8f9806d531. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:00:21.089980 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] [instance: 96324d90-865d-4477-bcf4-e10c61b01bfa] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:00:21.090874 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:21.091585 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:21.098072 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] [instance: 96324d90-865d-4477-bcf4-e10c61b01bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:00:21.100155 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:21.100580 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:21.128814 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:00:21.129226 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-d023ae84-1239-4220-975b-6066acad2949 tempest-VolumesBackupsTest-969089436 tempest-VolumesBackupsTest-969089436-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:00:59.551970 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:01:00.574505 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57284. Apr 30 05:01:16.505032 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:01:35.487301 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:01:36.537330 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58806. Apr 30 05:02:10.905071 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:02:11.926845 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59336. Apr 30 05:02:32.025064 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:02:32.051909 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:02:32.052418 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:02:32.122318 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:02:32.122800 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:02:32.123579 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:02:32.124036 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:02:32.140039 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:02:32.145639 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for user bfb96d32f5fe4dd3808901794d912193 and project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:02:32.156441 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: 9e833e5b-6e09-4294-8fd5-ed29449484a3] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:02:32.157401 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:02:32.157809 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:02:32.164813 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: 9e833e5b-6e09-4294-8fd5-ed29449484a3] block_device_mapping [BlockDeviceMapping(attachment_id=7c3f5ca0-e146-467a-a25b-dea1a0b547d1,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b31162e-2ffb-4f7b-a1cc-5821f66816f1',volume_size=1,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:02:32.166032 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:02:32.166436 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:02:32.199692 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:02:32.200295 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-78d4d43b-8c56-43e1-a956-01388e5e1adf tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:02:32.667456 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:02:55.130369 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:02:56.963778 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:02:58.155686 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:02:59.175060 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59898. Apr 30 05:03:22.436788 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:03:22.468494 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:03:22.468900 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:03:22.510095 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:03:22.510413 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:03:22.511126 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:03:22.511513 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:03:22.526933 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:03:22.531334 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for user bfb96d32f5fe4dd3808901794d912193 and project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:03:22.542262 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: ae702b34-dac4-4a1b-bbc8-d38b6355ab78] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:03:22.543207 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:03:22.543599 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:03:22.550831 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: ae702b34-dac4-4a1b-bbc8-d38b6355ab78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a2ecfaa4-a555-4b64-accb-ccb485ffa813',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:03:22.552126 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:03:22.552550 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:03:22.581567 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:03:22.581971 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-9dbec46f-5958-43b2-bb12-89aba94fbb1e tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:00.576854 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:04:01.596518 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32996. Apr 30 05:04:21.270452 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:04:21.293703 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:21.294108 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:21.337804 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:21.338211 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:21.338938 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:21.339330 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:21.356099 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:04:21.361882 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for user bfb96d32f5fe4dd3808901794d912193 and project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:04:21.372817 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: 78ec6a28-fd1e-4c8c-8780-bc1d01d96ff1] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:04:21.373774 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:21.374173 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:21.381174 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: 78ec6a28-fd1e-4c8c-8780-bc1d01d96ff1] block_device_mapping [BlockDeviceMapping(attachment_id=b5dee046-9547-4104-87b7-c5de2ee6813c,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93a1bd2e-3464-4e3e-930b-a3c21ad8be7c',volume_size=1,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:04:21.382385 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:21.382785 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:21.410833 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:21.411277 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-86622b65-1ef3-4215-982d-f3d1300ffb18 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:36.528364 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:04:36.540831 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:04:37.559793 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33638. Apr 30 05:04:42.497134 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:04:42.520594 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:42.521272 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:42.587497 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:42.587958 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:42.588763 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:42.589132 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:42.604736 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:04:42.609692 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for user bfb96d32f5fe4dd3808901794d912193 and project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:04:42.620074 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: dfbb2c6c-78e6-4628-93bb-23b0f39644a5] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:04:42.621048 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:42.621446 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:42.629587 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: dfbb2c6c-78e6-4628-93bb-23b0f39644a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='df9d0786-9851-49f6-a217-6994acf4d119',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:04:42.630825 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:42.631225 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:04:42.669203 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:04:42.669605 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-25a31c27-b327-4b4c-86a1-273aea8f3be3 tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:39.316537 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:05:39.339375 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:39.339783 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:39.399963 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:39.400409 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:39.401214 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:39.401806 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:39.422328 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Getting quotas for project a855a17a01c84b1ea70675185fc74e05. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:05:39.426944 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Getting quotas for user 9093e929182246b3984f08ace05ff669 and project a855a17a01c84b1ea70675185fc74e05. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:05:39.438024 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] [instance: 9a958e7d-023f-4355-9a02-2e46ff55b72a] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:05:39.439052 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:39.439450 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:39.452447 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] [instance: 9a958e7d-023f-4355-9a02-2e46ff55b72a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:05:39.454263 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:39.454729 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:39.495103 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:39.495868 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a04a5768-50e4-4ca7-a511-a87d8c7afc73 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:52.686025 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:05:55.784192 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:05:55.807046 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:55.807446 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:55.848165 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:55.848684 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:55.849386 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:55.849769 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:55.864769 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:05:55.869095 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for user bfb96d32f5fe4dd3808901794d912193 and project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:05:55.879808 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: 3a15ec4a-05d8-4f2d-b922-5d31cb60eb38] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:05:55.880743 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:55.881139 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:55.887032 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: 3a15ec4a-05d8-4f2d-b922-5d31cb60eb38] block_device_mapping [BlockDeviceMapping(attachment_id=407846ef-b5bf-4011-b3e5-e17b41a3f7cd,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85834da1-9da7-49a0-9d74-19fb8e3ea82b',volume_size=1,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:05:55.888270 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:55.888762 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:05:55.914781 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:05:55.915208 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-95da1ccb-b22c-4478-b5e5-872aba169cba tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:06:32.940452 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:06:32.962626 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:06:32.963063 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:06:33.004695 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:06:33.005093 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:06:33.005814 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:06:33.006206 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:06:33.021404 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Getting quotas for project a855a17a01c84b1ea70675185fc74e05. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:06:33.025755 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Getting quotas for user 9093e929182246b3984f08ace05ff669 and project a855a17a01c84b1ea70675185fc74e05. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:06:33.040293 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] [instance: 2b05bcf4-1952-44ad-b7c1-30647b0dbe1d] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:06:33.041280 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:06:33.041723 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:06:33.048867 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] [instance: 2b05bcf4-1952-44ad-b7c1-30647b0dbe1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:06:33.050026 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:06:33.050425 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:06:33.075483 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:06:33.076018 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-cc79cf68-7370-48d4-8e61-ba3cac2881b2 tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:07:01.596416 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:07:02.613017 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 35386. Apr 30 05:07:37.560696 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:07:38.578959 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 35550. Apr 30 05:07:38.944034 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:07:38.971208 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:07:38.971615 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:07:39.018155 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:07:39.018155 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:07:39.018797 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:07:39.019187 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:07:39.034807 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Getting quotas for project a855a17a01c84b1ea70675185fc74e05. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:07:39.039322 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Getting quotas for user 9093e929182246b3984f08ace05ff669 and project a855a17a01c84b1ea70675185fc74e05. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:07:39.051669 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] [instance: 3a9a71e8-68a6-4e1b-89e4-79d3011b0f2c] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:07:39.052657 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:07:39.053056 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:07:39.060628 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] [instance: 3a9a71e8-68a6-4e1b-89e4-79d3011b0f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:07:39.062522 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:07:39.063100 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:07:39.090454 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:07:39.090995 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-366ce50b-040d-47d1-9b23-c54406e88abd tempest-TestNetworkBasicOps-2135395712 tempest-TestNetworkBasicOps-2135395712-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:07:56.550935 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:08:20.042653 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:08:20.065857 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:20.066259 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:20.110154 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:20.110557 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:20.111301 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:20.111689 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:20.126704 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:08:20.131089 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for user bfb96d32f5fe4dd3808901794d912193 and project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:08:20.142262 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: c906f8b4-095c-490a-84e8-4f2e642f0881] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:08:20.143185 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:20.143561 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:20.149774 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: c906f8b4-095c-490a-84e8-4f2e642f0881] block_device_mapping [BlockDeviceMapping(attachment_id=ec5d21c8-646c-4664-8b39-ce74cc8932b6,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85834da1-9da7-49a0-9d74-19fb8e3ea82b',volume_size=1,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:08:20.151057 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:20.151450 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:20.178416 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:20.178822 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-69f01dc9-4820-47ef-b5c3-af0ad2e1a09c tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:53.369610 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:08:53.394446 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:53.394958 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:53.452250 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:53.452746 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:53.453550 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:53.454003 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:53.470360 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Getting quotas for project 5bf0717ed92d4c34b6bafad3ad1f5a00. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:08:53.474881 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Getting quotas for user 08b317c8e9214c878e5359926246fdc4 and project 5bf0717ed92d4c34b6bafad3ad1f5a00. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:08:53.486302 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] [instance: 46145974-ee07-42f9-a19c-824394925ab4] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:08:53.487432 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:53.487975 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:53.494921 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] [instance: 46145974-ee07-42f9-a19c-824394925ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:08:53.495985 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:53.496891 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:08:53.542831 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:08:53.543227 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-df3243f8-c207-47ae-808e-01d7f0f689ed tempest-TestServerBasicOps-771771483 tempest-TestServerBasicOps-771771483-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:09:12.704879 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:10:02.613559 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:10:03.629689 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36052. Apr 30 05:10:24.210369 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Took 0.19 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:10:24.231919 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:10:24.232342 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:10:24.275198 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:10:24.275604 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:10:24.276387 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:10:24.276782 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:10:24.292269 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:10:24.297737 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Getting quotas for user bfb96d32f5fe4dd3808901794d912193 and project db4e98d0413845e0aa5e8f7e66159e97. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:10:24.308039 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: 16599d3b-ee8c-4b40-8cb8-650a91599e7d] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:10:24.309079 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:10:24.309490 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:10:24.315568 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] [instance: 16599d3b-ee8c-4b40-8cb8-650a91599e7d] block_device_mapping [BlockDeviceMapping(attachment_id=70af3b85-6b2d-4399-b5ec-a19bbdc460b8,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='827a2c3b-5e1e-49a0-9c9d-e6108f55f5ad',volume_size=1,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:10:24.316844 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:10:24.317200 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:10:24.342539 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:10:24.342930 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-49bdb434-f012-4197-98b2-c2951ca6f40d tempest-TestVolumeBootPattern-704041605 tempest-TestVolumeBootPattern-704041605-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:10:38.578638 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:10:39.595153 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36136. Apr 30 05:10:59.179667 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:11:00.198032 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36168. Apr 30 05:11:11.928559 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:11:12.949448 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36178. Apr 30 05:11:15.153011 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:11:16.567141 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:11:16.985701 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:12:32.722174 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:13:03.630233 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:13:04.645784 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36362. Apr 30 05:13:04.840544 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:13:06.674919 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:13:06.820339 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:13:07.836564 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36374. Apr 30 05:13:11.951606 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:13:12.974306 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36378. Apr 30 05:13:39.596649 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:13:40.614307 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36380. Apr 30 05:14:00.197549 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:14:01.216545 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36450. Apr 30 05:14:12.945724 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:14:13.444571 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:14:13.466719 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:13.467133 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:13.514081 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:13.514583 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:13.515355 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:13.515748 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:13.531315 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Getting quotas for project 09d3d22feae14383a2190cf9cf1839b1. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:14:13.535697 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Getting quotas for user 76a86a0a6dbf42f7a85a1d7f771db143 and project 09d3d22feae14383a2190cf9cf1839b1. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:14:13.546118 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] [instance: 3f1f0110-7c27-482e-bc68-24539c3a48a5] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:14:13.547035 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:13.547469 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:13.553815 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] [instance: 3f1f0110-7c27-482e-bc68-24539c3a48a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:14:13.555075 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:13.555479 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:13.582232 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:13.582682 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-29ecf1bd-af0e-4207-9546-627b7434156f tempest-ServersAdminNegativeTestJSON-189777524 tempest-ServersAdminNegativeTestJSON-189777524-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:13.971062 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36544. Apr 30 05:14:34.830327 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Took 2.42 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:14:34.853077 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:34.853482 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:34.899918 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:34.900397 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:34.901073 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:34.901464 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:34.917671 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Getting quotas for project 3008d03fce8245de817ead9bd150b56e. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:14:34.922031 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Getting quotas for user 2e2fd8ab8c8e4270b507fc99ecd43d1d and project 3008d03fce8245de817ead9bd150b56e. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:14:34.933270 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] [instance: 9fd74ed7-9be8-4ba2-92a0-a83e3d6fc1fd] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:14:34.934188 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:34.934585 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:34.941138 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] [instance: 9fd74ed7-9be8-4ba2-92a0-a83e3d6fc1fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:14:34.942301 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:34.942720 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:34.968947 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:34.969348 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-6e8ea200-f00b-4f01-a73d-d7e821cecc12 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:35.169964 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:14:36.582889 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:14:37.001333 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:14:45.372452 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-bf06577b-85d1-414c-9bb5-ef2bd98fd557 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:14:45.373009 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bf06577b-85d1-414c-9bb5-ef2bd98fd557 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:14:45.373312 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-bf06577b-85d1-414c-9bb5-ef2bd98fd557 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:14:45.614771 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-bf06577b-85d1-414c-9bb5-ef2bd98fd557 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] [instance: 9fd74ed7-9be8-4ba2-92a0-a83e3d6fc1fd] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 05:14:45.911423 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-bf06577b-85d1-414c-9bb5-ef2bd98fd557 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] Created allocations for migration 4ab291c6-9360-4a8d-aefa-6c4273058b88 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 05:14:46.141973 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-bf06577b-85d1-414c-9bb5-ef2bd98fd557 tempest-DeleteServersTestJSON-1490524354 tempest-DeleteServersTestJSON-1490524354-project] [instance: 9fd74ed7-9be8-4ba2-92a0-a83e3d6fc1fd] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"9af7e94c-c36e-4570-becd-82af4f5fb2a0": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["9af7e94c-c36e-4570-becd-82af4f5fb2a0"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=9af7e94c-c36e-4570-becd-82af4f5fb2a0,limits=SchedulerLimits,nodename='n-h2-763928-2',service_host='n-h2-763928-2')] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 05:15:28.827163 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:15:28.848999 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:15:28.849408 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:15:28.896425 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:15:28.896866 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:15:28.897632 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:15:28.898026 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:15:28.913995 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Getting quotas for project 339dbdbc188644d6b2e290dc3de50205. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:15:28.918977 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Getting quotas for user cfaa6b09aab444d6ad6823546686a21a and project 339dbdbc188644d6b2e290dc3de50205. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:15:28.928977 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] [instance: 83cb48ee-fede-4028-bc64-b1fce811584b] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:15:28.929877 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:15:28.930282 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:15:28.936678 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] [instance: 83cb48ee-fede-4028-bc64-b1fce811584b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:15:28.937838 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:15:28.938240 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:15:28.962891 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:15:28.963287 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c0ef2cd0-453c-4aec-9f82-1f8952feb68a tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:15:40.845173 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-6d51ad15-62af-4096-b7ab-5fc3d9444b16 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:15:40.845674 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6d51ad15-62af-4096-b7ab-5fc3d9444b16 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:15:40.846039 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-6d51ad15-62af-4096-b7ab-5fc3d9444b16 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:15:41.139412 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-6d51ad15-62af-4096-b7ab-5fc3d9444b16 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] [instance: 83cb48ee-fede-4028-bc64-b1fce811584b] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 05:15:41.487386 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-6d51ad15-62af-4096-b7ab-5fc3d9444b16 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Created allocations for migration 5b551e5f-23fb-444b-a7c2-775c4fe57457 on 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 05:15:41.694277 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-6d51ad15-62af-4096-b7ab-5fc3d9444b16 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] [instance: 83cb48ee-fede-4028-bc64-b1fce811584b] Calling prep_resize with selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"1508a0ee-85c8-42eb-a6ba-5ec68c136fa8": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1508a0ee-85c8-42eb-a6ba-5ec68c136fa8"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=1508a0ee-85c8-42eb-a6ba-5ec68c136fa8,limits=SchedulerLimits,nodename='n-h1-763928-2',service_host='n-h1-763928-2')] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 05:15:52.738789 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:16:04.647437 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:16:05.665480 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37022. Apr 30 05:16:20.010776 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:16:20.033197 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:16:20.033597 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:16:20.079252 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:16:20.079655 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:16:20.080404 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:16:20.080797 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:16:20.095657 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Getting quotas for project 339dbdbc188644d6b2e290dc3de50205. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:16:20.100002 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Getting quotas for user cfaa6b09aab444d6ad6823546686a21a and project 339dbdbc188644d6b2e290dc3de50205. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:16:20.110294 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] [instance: a307afe6-1d8f-4cd1-9527-a66cec820d37] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:16:20.111209 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:16:20.111607 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:16:20.118068 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] [instance: a307afe6-1d8f-4cd1-9527-a66cec820d37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:16:20.119434 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:16:20.119834 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:16:20.148036 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:16:20.148546 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7fc17941-a58b-42dc-b1ff-7aeaa5fa637d tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:16:29.111001 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-fa0ade9e-23df-4179-850b-94baddeefd80 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:16:29.111614 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fa0ade9e-23df-4179-850b-94baddeefd80 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:16:29.112054 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-fa0ade9e-23df-4179-850b-94baddeefd80 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:16:29.284849 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-fa0ade9e-23df-4179-850b-94baddeefd80 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] [instance: a307afe6-1d8f-4cd1-9527-a66cec820d37] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 05:16:29.554694 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-fa0ade9e-23df-4179-850b-94baddeefd80 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] Created allocations for migration 28d7efef-1355-465d-8b34-986299cc4cde on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 05:16:29.757217 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-fa0ade9e-23df-4179-850b-94baddeefd80 tempest-ServerDiskConfigTestJSON-2051518315 tempest-ServerDiskConfigTestJSON-2051518315-project] [instance: a307afe6-1d8f-4cd1-9527-a66cec820d37] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"9af7e94c-c36e-4570-becd-82af4f5fb2a0": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["9af7e94c-c36e-4570-becd-82af4f5fb2a0"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=9af7e94c-c36e-4570-becd-82af4f5fb2a0,limits=SchedulerLimits,nodename='n-h2-763928-2',service_host='n-h2-763928-2')] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 05:16:40.614723 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:16:41.631993 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37162. Apr 30 05:17:21.748094 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:17:21.780209 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:17:21.783007 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:17:21.834118 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:17:21.834537 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:17:21.835304 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:17:21.835698 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:17:21.852613 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Getting quotas for project 6a9aa8846f6b471f8c4ce5d763c9b684. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:17:21.857426 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Getting quotas for user cafaf2cfc4e24cc7ad502e948de2f93b and project 6a9aa8846f6b471f8c4ce5d763c9b684. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:17:21.869046 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: c4bc7acc-0a23-4bed-9e64-480857daed18] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:17:21.870332 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:17:21.870851 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:17:21.880664 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: c4bc7acc-0a23-4bed-9e64-480857daed18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:17:21.882157 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:17:21.882631 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:17:21.917187 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:17:21.917696 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-bbb65511-254a-46ae-8627-f56e39c1c284 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:17:56.600071 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:19:01.219543 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:19:02.236098 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37574. Apr 30 05:19:05.665335 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:19:06.681156 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37584. Apr 30 05:19:12.755701 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:19:13.293447 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:19:13.293963 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:19:13.294331 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:19:13.588669 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: c4bc7acc-0a23-4bed-9e64-480857daed18] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 05:19:13.899956 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Created allocations for migration 9880eaa5-4e8d-469c-b244-0238709f8212 on 1508a0ee-85c8-42eb-a6ba-5ec68c136fa8 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 05:19:13.906022 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [a43233a9-c8af-4fca-88e5-cbff411f85b4] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 05:19:14.922042 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [a43233a9-c8af-4fca-88e5-cbff411f85b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37648. Apr 30 05:19:15.120672 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: c4bc7acc-0a23-4bed-9e64-480857daed18] Calling prep_resize with selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"1508a0ee-85c8-42eb-a6ba-5ec68c136fa8": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1508a0ee-85c8-42eb-a6ba-5ec68c136fa8"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=1508a0ee-85c8-42eb-a6ba-5ec68c136fa8,limits=SchedulerLimits,nodename='n-h1-763928-2',service_host='n-h1-763928-2')] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 05:19:15.130286 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [2bff9143-2072-410b-8585-fa088e769924] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 05:19:16.146567 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6559daf-ed11-402d-93be-7dac0b32c18b tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [2bff9143-2072-410b-8585-fa088e769924] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37660. Apr 30 05:19:41.632862 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:19:42.649478 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37738. Apr 30 05:19:45.424788 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Took 2.34 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:19:45.447162 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:19:45.447576 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:19:45.492403 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:19:45.492752 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:19:45.493484 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:19:45.493878 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:19:45.511698 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Getting quotas for project 6a9aa8846f6b471f8c4ce5d763c9b684. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:19:45.517216 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Getting quotas for user cafaf2cfc4e24cc7ad502e948de2f93b and project 6a9aa8846f6b471f8c4ce5d763c9b684. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:19:45.527294 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: bc2f3be1-9dad-46d4-a8dc-799f7c884ea5] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:19:45.528187 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:19:45.528660 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:19:45.535251 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: bc2f3be1-9dad-46d4-a8dc-799f7c884ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:19:45.536540 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:19:45.536946 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:19:45.561667 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:19:45.562111 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-4e6dd583-13b5-4651-89fb-b109c7094d26 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:21:13.972173 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:21:14.993885 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37950. Apr 30 05:21:16.616575 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:21:45.800363 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c19bf667-7583-438e-90e5-31c9e339370a tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:21:45.800896 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c19bf667-7583-438e-90e5-31c9e339370a tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:21:45.801486 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c19bf667-7583-438e-90e5-31c9e339370a tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:21:46.026740 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-c19bf667-7583-438e-90e5-31c9e339370a tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: bc2f3be1-9dad-46d4-a8dc-799f7c884ea5] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80830) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 05:21:46.325389 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-c19bf667-7583-438e-90e5-31c9e339370a tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Created allocations for migration 98c4256b-efd7-44ef-8075-df6e0f24cbae on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 05:21:46.617211 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-c19bf667-7583-438e-90e5-31c9e339370a tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: bc2f3be1-9dad-46d4-a8dc-799f7c884ea5] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"9af7e94c-c36e-4570-becd-82af4f5fb2a0": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["9af7e94c-c36e-4570-becd-82af4f5fb2a0"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=9af7e94c-c36e-4570-becd-82af4f5fb2a0,limits=SchedulerLimits,nodename='n-h2-763928-2',service_host='n-h2-763928-2')] {{(pid=80830) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 05:22:02.236941 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:22:03.256993 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38106. Apr 30 05:22:06.152929 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:22:06.177972 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:22:06.178474 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:22:06.221826 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:22:06.222144 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:22:06.222859 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:22:06.223245 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:22:06.240723 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Getting quotas for project 6a9aa8846f6b471f8c4ce5d763c9b684. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:22:06.245201 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Getting quotas for user cafaf2cfc4e24cc7ad502e948de2f93b and project 6a9aa8846f6b471f8c4ce5d763c9b684. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:22:06.255848 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: 0249d547-a5ec-4ed1-8978-9d30f35722db] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:22:06.256789 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:22:06.257184 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:22:06.263057 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: 0249d547-a5ec-4ed1-8978-9d30f35722db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:22:06.264278 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:22:06.264696 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:22:06.293968 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:22:06.294368 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-90e716da-101b-4ecf-a020-caba7ee9b5be tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:22:06.682347 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:22:07.699337 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38144. Apr 30 05:22:32.774552 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:22:42.650379 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:22:43.668074 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38226. Apr 30 05:23:54.773765 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-62aafa12-9eac-4e52-bd4c-6051a7ed8661 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:23:54.774362 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-62aafa12-9eac-4e52-bd4c-6051a7ed8661 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:23:54.774642 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-62aafa12-9eac-4e52-bd4c-6051a7ed8661 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:23:54.941462 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-62aafa12-9eac-4e52-bd4c-6051a7ed8661 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: 0249d547-a5ec-4ed1-8978-9d30f35722db] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80830) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 05:23:55.215009 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-62aafa12-9eac-4e52-bd4c-6051a7ed8661 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Created allocations for migration 2f0b5fe6-ded6-4474-9fdd-230ca33559e8 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80830) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 05:23:55.416822 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.tasks.migrate [None req-62aafa12-9eac-4e52-bd4c-6051a7ed8661 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: 0249d547-a5ec-4ed1-8978-9d30f35722db] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"9af7e94c-c36e-4570-becd-82af4f5fb2a0": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["9af7e94c-c36e-4570-becd-82af4f5fb2a0"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=9af7e94c-c36e-4570-becd-82af4f5fb2a0,limits=SchedulerLimits,nodename='n-h2-763928-2',service_host='n-h2-763928-2')] {{(pid=80830) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 05:24:14.990245 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:24:16.012151 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38430. Apr 30 05:24:27.513207 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:24:27.536048 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:24:27.536483 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:24:27.581132 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:24:27.581465 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:24:27.582193 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:24:27.582586 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:24:27.598544 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Getting quotas for project 6a9aa8846f6b471f8c4ce5d763c9b684. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:24:27.602924 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Getting quotas for user cafaf2cfc4e24cc7ad502e948de2f93b and project 6a9aa8846f6b471f8c4ce5d763c9b684. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:24:27.613459 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: 201ed3d3-7c52-4133-9ba8-f7187c1783f0] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:24:27.614357 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:24:27.614754 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:24:27.621038 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: 201ed3d3-7c52-4133-9ba8-f7187c1783f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:24:27.622330 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:24:27.622784 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:24:27.650421 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:24:27.650929 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-edf45b86-4c83-46da-80e8-fcdaa867ffdd tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:24:35.194395 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:24:36.634376 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:24:37.024718 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:25:03.257315 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:25:04.274152 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38586. Apr 30 05:25:07.700223 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:25:08.717127 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38596. Apr 30 05:25:43.667411 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:25:44.683971 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38664. Apr 30 05:25:52.792377 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:26:30.456682 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-1fbb101d-3167-46c8-9ccc-9c742501ee55 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:26:30.457203 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1fbb101d-3167-46c8-9ccc-9c742501ee55 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:26:30.457563 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-1fbb101d-3167-46c8-9ccc-9c742501ee55 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:26:30.816325 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-1fbb101d-3167-46c8-9ccc-9c742501ee55 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: 201ed3d3-7c52-4133-9ba8-f7187c1783f0] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 05:26:31.090008 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-1fbb101d-3167-46c8-9ccc-9c742501ee55 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] Created allocations for migration c6c8ee4c-7778-49be-9591-996d112687f2 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 05:26:31.381486 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-1fbb101d-3167-46c8-9ccc-9c742501ee55 tempest-ServerActionsTestJSON-1120651589 tempest-ServerActionsTestJSON-1120651589-project] [instance: 201ed3d3-7c52-4133-9ba8-f7187c1783f0] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"9af7e94c-c36e-4570-becd-82af4f5fb2a0": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["9af7e94c-c36e-4570-becd-82af4f5fb2a0"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=9af7e94c-c36e-4570-becd-82af4f5fb2a0,limits=SchedulerLimits,nodename='n-h2-763928-2',service_host='n-h2-763928-2')] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 05:27:07.849029 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:27:08.867222 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38886. Apr 30 05:27:12.982501 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:27:14.004252 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38900. Apr 30 05:27:42.832291 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:27:42.854648 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:42.855055 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:42.903970 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:42.904429 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:42.905169 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:42.905564 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:42.921170 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Getting quotas for project 6fe1825e6b3a48999dae2ffba638b67c. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:27:42.925546 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Getting quotas for user 9938c5782b9b49d2bdcc0cd4b161f6c9 and project 6fe1825e6b3a48999dae2ffba638b67c. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:27:42.936051 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] [instance: 3c350c54-ed5d-4a58-b93f-3518a26bc042] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:27:42.937043 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:42.937450 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:42.944015 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] [instance: 3c350c54-ed5d-4a58-b93f-3518a26bc042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:27:42.945279 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:42.945675 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:42.971478 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:42.971881 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-04e48baf-a582-407e-8468-ebb75a0551ff tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:55.020053 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:27:55.043099 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:55.043498 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:55.092697 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:55.093095 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:55.093928 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:55.094313 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:55.110372 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Getting quotas for project 6fe1825e6b3a48999dae2ffba638b67c. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:27:55.115378 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Getting quotas for user 9938c5782b9b49d2bdcc0cd4b161f6c9 and project 6fe1825e6b3a48999dae2ffba638b67c. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:27:55.127044 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] [instance: 56bd41c1-0dcc-461d-aa11-fcaf14d00cde] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:27:55.127972 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:55.128396 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:55.136298 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] [instance: 56bd41c1-0dcc-461d-aa11-fcaf14d00cde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:27:55.137538 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:55.137925 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:55.168599 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:27:55.168955 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-acaedb05-4cea-46e9-9da3-899786f8c964 tempest-ServersNegativeTestJSON-1397097156 tempest-ServersNegativeTestJSON-1397097156-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:27:56.651653 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:28:08.718367 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:28:09.734073 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39158. Apr 30 05:28:44.687088 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:28:45.707123 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39398. Apr 30 05:29:06.586120 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:29:06.608826 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:06.609143 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:06.659268 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:06.659668 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:06.660669 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:06.661059 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:06.677724 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Getting quotas for project cb1807cc699444b69afec234cc4a61a2. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:29:06.683823 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Getting quotas for user ce8379b7391443eab1485dcec0d47a38 and project cb1807cc699444b69afec234cc4a61a2. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:29:06.694793 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] [instance: 06795cdc-6f5c-4cf9-890d-c2b1696f9654] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:29:06.696858 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:06.697271 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:06.704886 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] [instance: 06795cdc-6f5c-4cf9-890d-c2b1696f9654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:29:06.706633 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:06.707032 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:06.737447 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:06.737984 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-b23d0147-3367-4213-85cd-b01e30370f90 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:12.809482 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:29:44.383749 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:29:44.406032 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:44.406431 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:44.449253 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:44.449587 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:44.450312 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:44.450708 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:44.465573 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Getting quotas for project cb1807cc699444b69afec234cc4a61a2. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:29:44.469939 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Getting quotas for user ce8379b7391443eab1485dcec0d47a38 and project cb1807cc699444b69afec234cc4a61a2. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:29:44.479988 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] [instance: ca48c0b5-26de-4d72-9d88-b775708ff48b] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:29:44.480909 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:44.481315 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:44.487301 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] [instance: ca48c0b5-26de-4d72-9d88-b775708ff48b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:29:44.488485 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:44.488884 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:29:44.515027 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:29:44.515436 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-7236a935-836e-44f0-8d2a-e7a5b511ef64 tempest-TestEncryptedCinderVolumes-2030300237 tempest-TestEncryptedCinderVolumes-2030300237-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:30:56.114709 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:30:56.137185 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:30:56.137596 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:30:56.191003 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:30:56.191405 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:30:56.192148 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:30:56.192565 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:30:56.207421 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Getting quotas for project c7941cd1f1b84e8bb5a34e2b0be83c6e. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:30:56.211790 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Getting quotas for user ea5f3e03e94d48e2a8cc1fd0ddc06d92 and project c7941cd1f1b84e8bb5a34e2b0be83c6e. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:30:56.222528 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] [instance: a396895f-04b8-485b-8705-743a4e7ac342] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:30:56.223435 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:30:56.223834 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:30:56.230784 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] [instance: a396895f-04b8-485b-8705-743a4e7ac342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='318abf6d-432a-4959-a240-9cb516e8c18b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:30:56.231945 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:30:56.232361 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:30:56.259039 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:30:56.259971 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-4a3c1ce2-c0f4-42bc-83e9-09ce9bbec359 tempest-TestMinimumBasicScenario-1182688056 tempest-TestMinimumBasicScenario-1182688056-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:31:09.734517 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:31:10.751531 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40048. Apr 30 05:31:16.670064 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:31:45.707957 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:31:46.723978 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40180. Apr 30 05:32:08.869495 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:32:09.885580 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40212. Apr 30 05:32:14.002471 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:32:15.024306 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40216. Apr 30 05:32:32.825997 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:33:04.280099 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:33:05.296371 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40424. Apr 30 05:33:15.331831 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:33:15.356194 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:33:15.356619 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:33:15.406886 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:33:15.407291 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:33:15.408052 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:33:15.408480 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:33:15.424302 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:33:15.429051 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for user ab0126595a584171951c2bb1de04ca09 and project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:33:15.440446 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: d68fd5ef-c0e7-42f7-bcc7-af536d300a6f] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:33:15.441472 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:33:15.441937 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:33:15.448990 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: d68fd5ef-c0e7-42f7-bcc7-af536d300a6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:33:15.450172 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:33:15.450598 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:33:15.479048 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:33:15.479559 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-d8693c0f-7193-4cc6-8d92-12d605779e13 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:34:10.752473 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:34:11.769643 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40616. Apr 30 05:34:27.479219 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [6d3188d8-0170-41ae-995a-bc03e9014d74] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 05:34:28.497668 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [6d3188d8-0170-41ae-995a-bc03e9014d74] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40714. Apr 30 05:34:28.850701 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Took 1.38 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:34:28.875178 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:34:28.875578 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:34:28.923512 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:34:28.923912 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:34:28.924674 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:34:28.925060 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:34:28.940885 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:34:28.945517 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for user ab0126595a584171951c2bb1de04ca09 and project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:34:28.956383 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 303339a0-a4d6-4e48-a069-fd1d478c7656] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:34:28.957340 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:34:28.957735 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:34:28.964417 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 303339a0-a4d6-4e48-a069-fd1d478c7656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:34:28.965648 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:34:28.966042 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:34:28.999218 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:34:28.999813 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:34:29.008998 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [b4a711f9-2a81-4ed1-aa57-fea2d1d4d1a4] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 05:34:30.024678 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [None req-a53672c0-7698-46af-8666-a84874e2ad1d tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [b4a711f9-2a81-4ed1-aa57-fea2d1d4d1a4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40732. Apr 30 05:34:36.687105 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:34:46.725376 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:34:47.743193 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40786. Apr 30 05:35:16.016810 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:35:17.042444 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40806. Apr 30 05:35:52.842856 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:36:05.297861 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:36:06.315204 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40858. Apr 30 05:36:15.221357 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:36:17.050187 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:36:25.776489 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:36:25.798850 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:36:25.799256 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:36:25.844138 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:36:25.844511 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:36:25.845184 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:36:25.845568 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:36:25.860587 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:36:25.865622 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for user ab0126595a584171951c2bb1de04ca09 and project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:36:25.875680 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 276c7468-73d0-4765-b5bf-7eeac9a40c58] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:36:25.876637 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:36:25.877036 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:36:25.884844 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 276c7468-73d0-4765-b5bf-7eeac9a40c58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:36:25.886093 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:36:25.886493 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:36:25.915491 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:36:25.915929 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-a03f1aa9-96eb-4a8b-bb9a-1ad91d78ff05 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:37:08.717648 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-daddb56f-3da1-4be0-9339-589ac8d7086a tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method migrate_server {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:37:08.718164 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-daddb56f-3da1-4be0-9339-589ac8d7086a tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:37:08.718522 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-daddb56f-3da1-4be0-9339-589ac8d7086a tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:37:08.934987 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-daddb56f-3da1-4be0-9339-589ac8d7086a tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 276c7468-73d0-4765-b5bf-7eeac9a40c58] Restricting to cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) while migrating {{(pid=80831) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 30 05:37:09.261649 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-daddb56f-3da1-4be0-9339-589ac8d7086a tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Created allocations for migration 3c5cc6e8-4785-449f-b7dc-defc863f4b67 on 9af7e94c-c36e-4570-becd-82af4f5fb2a0 {{(pid=80831) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 30 05:37:09.464726 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.tasks.migrate [None req-daddb56f-3da1-4be0-9339-589ac8d7086a tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 276c7468-73d0-4765-b5bf-7eeac9a40c58] Calling prep_resize with selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [Selection(allocation_request='{"allocations": {"9af7e94c-c36e-4570-becd-82af4f5fb2a0": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["9af7e94c-c36e-4570-becd-82af4f5fb2a0"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e,compute_node_uuid=9af7e94c-c36e-4570-becd-82af4f5fb2a0,limits=SchedulerLimits,nodename='n-h2-763928-2',service_host='n-h2-763928-2')] {{(pid=80831) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 30 05:37:11.770366 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:37:12.785736 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41084. Apr 30 05:37:47.743627 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:37:48.760219 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41130. Apr 30 05:37:56.705349 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:38:21.460438 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:38:21.483531 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:38:21.483873 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:38:21.530466 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:38:21.531236 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:38:21.532167 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:38:21.532793 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:38:21.549998 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:38:21.554514 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for user ab0126595a584171951c2bb1de04ca09 and project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:38:21.565539 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 22f701a4-e443-4a11-9916-028bfa7e5ab6] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:38:21.566772 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:38:21.567352 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:38:21.577616 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 22f701a4-e443-4a11-9916-028bfa7e5ab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:38:21.578580 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:38:21.578988 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:38:21.612357 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:38:21.612824 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-c961a0ec-6dcb-42af-a24f-8fd13fc2b752 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:39:12.859602 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:39:17.036773 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:39:18.059444 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41368. Apr 30 05:39:35.240549 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:39:37.068852 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:40:06.318278 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:40:07.335693 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41492. Apr 30 05:40:10.561205 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:40:10.587227 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:40:10.587641 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:40:10.640190 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:40:10.640633 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:40:10.641485 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:40:10.641873 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:40:10.657999 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:40:10.662421 n-d-763928-2 nova-conductor[80830]: DEBUG nova.quota [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Getting quotas for user ab0126595a584171951c2bb1de04ca09 and project fc0b64b13441458daeb68cc58e1e2557. Resources: {'ram', 'cores', 'instances'} {{(pid=80830) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:40:10.673243 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 502d2972-657e-4cb2-ae2a-ceca2dd38786] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80830) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:40:10.674146 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:40:10.674543 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:40:10.680942 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] [instance: 502d2972-657e-4cb2-ae2a-ceca2dd38786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80830) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:40:10.682368 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:40:10.682841 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:40:10.711017 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:40:10.711538 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-3eb8be1d-8f75-4ca4-8639-ceb0c4e6b485 tempest-TestNetworkAdvancedServerOps-384982700 tempest-TestNetworkAdvancedServerOps-384982700-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:40:12.787816 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:40:13.805141 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41528. Apr 30 05:40:48.760754 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:40:49.777541 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41574. Apr 30 05:41:16.724042 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:41:33.064891 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:41:33.086134 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:41:33.086542 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:41:33.133695 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:41:33.134093 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:41:33.135076 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:41:33.135467 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:41:33.150130 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Getting quotas for project 2090eedf7ba54171ab8847f6d63d1348. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:41:33.155015 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Getting quotas for user aded9158075946a2a077dd49bc8fd39c and project 2090eedf7ba54171ab8847f6d63d1348. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:41:33.165194 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [instance: ee43cf18-d729-4076-97fc-3f0e2cba7c36] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:41:33.166139 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:41:33.166536 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:41:33.175400 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [instance: ee43cf18-d729-4076-97fc-3f0e2cba7c36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:41:33.177074 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:41:33.177847 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:41:33.209497 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:41:33.210115 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-f162cb11-edf3-4bf3-995e-c598d37feb6a tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:42:15.027669 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:42:16.049555 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41862. Apr 30 05:42:32.875950 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:43:04.884140 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:43:06.718389 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:43:09.895023 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:43:10.910912 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41880. Apr 30 05:43:13.805618 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:43:14.821480 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41882. Apr 30 05:43:49.778387 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:43:50.793899 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41912. Apr 30 05:44:07.337638 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:44:08.356563 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41998. Apr 30 05:44:08.518381 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method unshelve_instance {{(pid=80831) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:44:08.518877 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:44:08.519279 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:44:08.939641 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [instance: ee43cf18-d729-4076-97fc-3f0e2cba7c36] Requesting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) during scheduling {{(pid=80831) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 30 05:44:08.949188 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [a43233a9-c8af-4fca-88e5-cbff411f85b4] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 05:44:09.966159 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [a43233a9-c8af-4fca-88e5-cbff411f85b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42020. Apr 30 05:44:12.221543 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Took 3.28 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:44:12.229934 n-d-763928-2 nova-conductor[80831]: DEBUG nova.objects.instance [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lazy-loading 'flavor' on Instance uuid ee43cf18-d729-4076-97fc-3f0e2cba7c36 {{(pid=80831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 05:44:12.287507 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [2bff9143-2072-410b-8585-fa088e769924] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 05:44:13.303091 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [None req-5cfa14ac-3173-4ee4-9302-f3d210f1d3ec tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [2bff9143-2072-410b-8585-fa088e769924] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42038. Apr 30 05:44:36.742590 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:45:16.045602 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:45:17.067709 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42156. Apr 30 05:45:52.893614 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:46:04.782291 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Took 0.19 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:46:04.804680 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:46:04.805028 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:46:04.846494 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:46:04.846910 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:46:04.847625 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:46:04.848692 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:46:04.863557 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Getting quotas for project 2090eedf7ba54171ab8847f6d63d1348. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:46:04.868180 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Getting quotas for user aded9158075946a2a077dd49bc8fd39c and project 2090eedf7ba54171ab8847f6d63d1348. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:46:04.878156 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [instance: a686ddd3-c9e8-4e81-bd27-f57e8dff5482] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:46:04.879036 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:46:04.879437 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:46:04.885747 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [instance: a686ddd3-c9e8-4e81-bd27-f57e8dff5482] block_device_mapping [BlockDeviceMapping(attachment_id=a2415daa-dc93-48c0-8b3c-5cde63b61537,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcd88fe2-300a-42f6-b2bb-a84e3ecada17',volume_size=1,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:46:04.886928 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:46:04.887320 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:46:04.914865 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:46:04.915260 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-c7dacb22-5bb2-4703-b8f1-b3e665f0f887 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:46:10.912599 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:46:11.929892 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42364. Apr 30 05:46:14.823195 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:46:15.841603 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42374. Apr 30 05:46:24.900675 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:46:26.734990 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:46:50.795196 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:46:51.811534 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42414. Apr 30 05:47:56.759268 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:48:08.357628 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:48:09.373380 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42432. Apr 30 05:48:17.063223 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:48:18.061739 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:48:18.103947 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42452. Apr 30 05:48:19.082618 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42454. Apr 30 05:48:31.959652 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-e066c0f9-1731-4a51-9e3d-3c3c130fa685 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Targeting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) for conductor method unshelve_instance {{(pid=80830) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 30 05:48:31.960166 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e066c0f9-1731-4a51-9e3d-3c3c130fa685 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:48:31.960545 n-d-763928-2 nova-conductor[80830]: DEBUG oslo_concurrency.lockutils [None req-e066c0f9-1731-4a51-9e3d-3c3c130fa685 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:48:32.100219 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-e066c0f9-1731-4a51-9e3d-3c3c130fa685 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] [instance: a686ddd3-c9e8-4e81-bd27-f57e8dff5482] Requesting cell b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e(cell1) during scheduling {{(pid=80830) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 30 05:48:32.418329 n-d-763928-2 nova-conductor[80830]: DEBUG nova.conductor.manager [None req-e066c0f9-1731-4a51-9e3d-3c3c130fa685 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=80830) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:48:32.426399 n-d-763928-2 nova-conductor[80830]: DEBUG nova.objects.instance [None req-e066c0f9-1731-4a51-9e3d-3c3c130fa685 tempest-TestShelveInstance-1864841251 tempest-TestShelveInstance-1864841251-project] Lazy-loading 'flavor' on Instance uuid a686ddd3-c9e8-4e81-bd27-f57e8dff5482 {{(pid=80830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 05:49:12.910788 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:49:15.841309 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:49:16.857245 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42544. Apr 30 05:49:51.812284 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:49:52.827845 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42556. Apr 30 05:50:44.953379 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] [a43233a9-c8af-4fca-88e5-cbff411f85b4] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 05:50:45.970472 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] [a43233a9-c8af-4fca-88e5-cbff411f85b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42764. Apr 30 05:50:46.383343 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Took 1.44 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:50:46.405124 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:50:46.405479 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:50:46.453461 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:50:46.453877 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:50:46.454577 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:50:46.454959 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:50:46.470207 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Getting quotas for project 08c19ecf801d4211b6c7ce40de4778e3. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:50:46.474761 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Getting quotas for user 2661b11ea2474057a0ef341f39f8ba25 and project 08c19ecf801d4211b6c7ce40de4778e3. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:50:46.484700 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] [instance: 3a3debfb-a00d-4422-a4e2-25b425fd7699] Selected host: n-h2-763928-2; Selected node: n-h2-763928-2; Alternates: [('n-h1-763928-2', 'n-h1-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:50:46.485599 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:50:46.485992 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:50:46.492135 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] [instance: 3a3debfb-a00d-4422-a4e2-25b425fd7699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27922792-9968-4c12-a8d3-679347a6f69a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:50:46.493335 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:50:46.493734 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:50:46.522067 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:50:46.522775 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:50:46.532156 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] [2bff9143-2072-410b-8585-fa088e769924] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 05:50:47.550577 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [None req-3bbcf4cd-0f66-4562-a9d8-e2805245c31f tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] [2bff9143-2072-410b-8585-fa088e769924] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42782. Apr 30 05:51:11.932951 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:51:12.950071 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42828. Apr 30 05:51:16.775121 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:51:18.100985 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:51:19.122788 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42840. Apr 30 05:51:24.921111 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:51:26.753300 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 30 05:52:16.858324 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:52:17.875566 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42860. Apr 30 05:52:32.931752 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:52:52.829290 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:52:53.846288 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42864. Apr 30 05:53:08.584223 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=80831) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 30 05:53:08.606617 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:53:08.607018 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:53:08.667701 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:53:08.668097 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:53:08.668888 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:53:08.669282 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:53:08.684773 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Getting quotas for project 08c19ecf801d4211b6c7ce40de4778e3. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 05:53:08.689224 n-d-763928-2 nova-conductor[80831]: DEBUG nova.quota [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Getting quotas for user 2661b11ea2474057a0ef341f39f8ba25 and project 08c19ecf801d4211b6c7ce40de4778e3. Resources: {'ram', 'cores', 'instances'} {{(pid=80831) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 05:53:08.699418 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] [instance: bd574818-8241-43a4-9a5c-98a7eb802494] Selected host: n-h1-763928-2; Selected node: n-h1-763928-2; Alternates: [('n-h2-763928-2', 'n-h2-763928-2')] {{(pid=80831) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 30 05:53:08.700300 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:53:08.700717 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:53:08.706766 n-d-763928-2 nova-conductor[80831]: DEBUG nova.conductor.manager [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] [instance: bd574818-8241-43a4-9a5c-98a7eb802494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7eaff126-b1fd-419b-a8a3-a6f198b315d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=80831) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 30 05:53:08.707908 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:53:08.708341 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:53:08.734341 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 05:53:08.734739 n-d-763928-2 nova-conductor[80831]: DEBUG oslo_concurrency.lockutils [None req-5ff5b8eb-8307-4b65-9ba2-612ddb7b6f69 tempest-TestSnapshotPattern-1547696492 tempest-TestSnapshotPattern-1547696492-project] Lock "b1c0ac3e-0cf4-4ac7-8820-e7a6bb0e255e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=80831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 05:54:12.950551 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:54:13.967438 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43106. Apr 30 05:54:19.118592 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:54:20.140452 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43112. Apr 30 05:54:36.791642 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:54:44.937670 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:54:46.769698 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:55:09.378632 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:55:10.394308 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43134. Apr 30 05:55:17.884736 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:55:18.907920 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43212. Apr 30 05:55:19.083728 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:55:20.138501 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43222. Apr 30 05:55:52.948800 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:55:53.847775 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:55:54.865166 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43452. Apr 30 05:56:15.271910 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:56:17.097245 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:57:13.968841 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:57:14.986611 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43464. Apr 30 05:57:20.136638 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:57:21.156960 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43468. Apr 30 05:57:56.811748 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:58:04.954657 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:58:06.787697 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:58:10.395654 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:58:11.412812 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43484. Apr 30 05:58:18.909131 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:58:19.926579 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43490. Apr 30 05:58:20.133880 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 05:58:21.155534 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43492. Apr 30 05:58:54.865526 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 05:58:55.883142 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43494. Apr 30 05:59:12.966582 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:59:35.289340 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 05:59:37.118285 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 06:00:14.986390 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 06:00:16.002989 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43512. Apr 30 06:00:21.153227 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 06:00:22.189030 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43516. Apr 30 06:01:11.414020 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 06:01:12.429930 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43522. Apr 30 06:01:16.829185 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 06:01:19.927301 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 06:01:20.944065 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43532. Apr 30 06:01:21.152606 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 06:01:22.173787 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43534. Apr 30 06:01:24.972093 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 06:01:26.804582 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 06:01:55.883371 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 06:01:56.900027 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c102ad6-80c3-4577-9633-4c1bd99bb9d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43544. Apr 30 06:02:32.983776 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 06:02:55.306559 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 06:02:57.136262 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 06:03:16.004612 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 06:03:17.020833 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [660cb0da-7080-4972-a10a-472b97103dba] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43558. Apr 30 06:03:22.179672 n-d-763928-2 nova-conductor[80830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 06:03:23.204308 n-d-763928-2 nova-conductor[80830]: INFO oslo.messaging._drivers.impl_rabbit [-] [75a5e5df-10df-4256-a82c-06ce668e97b4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43562. Apr 30 06:04:12.431603 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 06:04:13.448251 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d854f75b-4a6c-424d-84ca-b0c0c1e2462e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43564. Apr 30 06:04:20.945429 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 06:04:21.962859 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc56a2dc-af36-4872-a02d-4f120e9e5656] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43568. Apr 30 06:04:22.171266 n-d-763928-2 nova-conductor[80831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 06:04:23.194869 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] [c03acc15-e650-4e46-93c0-60dd6bb4e308] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43570. Apr 30 06:04:36.845415 n-d-763928-2 nova-conductor[80831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer