-- Logs begin at Thu 2022-07-28 09:43:16 UTC, end at Thu 2022-07-28 11:09:18 UTC. -- Jul 28 10:20:20.809627 n-d-850468-6 systemd[1]: Started Devstack devstack@n-super-cond.service. Jul 28 10:20:21.455644 n-d-850468-6 nova-conductor[110080]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 10:20:24.310388 n-d-850468-6 nova-conductor[110080]: INFO dbcounter [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Registered counter for database nova_api Jul 28 10:20:24.329254 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_db.sqlalchemy.engines [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:20:24.336051 n-d-850468-6 nova-conductor[110080]: DEBUG dbcounter [-] [110080] Writer thread running {{(pid=110080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:20:24.388225 n-d-850468-6 nova-conductor[110080]: DEBUG nova.context [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9e94609-c9be-4409-8579-80fe73a29a93(cell1) {{(pid=110080) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 10:20:24.391540 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_concurrency.lockutils [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:20:24.393453 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_concurrency.lockutils [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:20:24.394211 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_concurrency.lockutils [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:20:24.396142 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_concurrency.lockutils [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:20:24.397909 n-d-850468-6 nova-conductor[110080]: INFO dbcounter [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Registered counter for database nova_cell0 Jul 28 10:20:24.401388 n-d-850468-6 nova-conductor[110080]: INFO dbcounter [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Registered counter for database nova_cell1 Jul 28 10:20:24.414915 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_db.sqlalchemy.engines [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:20:24.415761 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_db.sqlalchemy.engines [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:20:24.423160 n-d-850468-6 nova-conductor[110080]: DEBUG dbcounter [-] [110080] Writer thread running {{(pid=110080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:20:24.423477 n-d-850468-6 nova-conductor[110080]: DEBUG dbcounter [-] [110080] Writer thread running {{(pid=110080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:20:24.555124 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_concurrency.lockutils [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Acquired lock "singleton_lock" {{(pid=110080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 10:20:24.555633 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_concurrency.lockutils [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Releasing lock "singleton_lock" {{(pid=110080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 10:20:24.556343 n-d-850468-6 nova-conductor[110080]: INFO oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Starting 2 workers Jul 28 10:20:24.561154 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Started child 110966 {{(pid=110080) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jul 28 10:20:24.566535 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Started child 110967 {{(pid=110080) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jul 28 10:20:24.567715 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Full set of CONF: {{(pid=110080) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jul 28 10:20:24.568133 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ******************************************************************************** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 10:20:24.568501 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] Configuration options gathered from: {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 10:20:24.568903 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 10:20:24.569590 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] config files: ['/etc/nova/nova.conf'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 10:20:24.569941 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ================================================================================ {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 10:20:24.570704 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] allow_resize_to_same_host = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.571220 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] arq_binding_timeout = 300 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.571671 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] block_device_allocate_retries = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.571970 n-d-850468-6 nova-conductor[110966]: INFO nova.service [-] Starting conductor node (version 25.1.0) Jul 28 10:20:24.572460 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] block_device_allocate_retries_interval = 3 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.572545 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cert = self.pem {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.572973 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute_driver = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.573503 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute_monitors = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.580864 n-d-850468-6 nova-conductor[110967]: INFO nova.service [-] Starting conductor node (version 25.1.0) Jul 28 10:20:24.584684 n-d-850468-6 nova-conductor[110966]: INFO dbcounter [None req-20fdf692-0533-4c05-ba43-288824a63727 None None] Registered counter for database nova_cell0 Jul 28 10:20:24.586181 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] config_dir = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.586746 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] config_drive_format = iso9660 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.587109 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] config_file = ['/etc/nova/nova.conf'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.587584 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] config_source = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.588031 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] console_host = n-d-850468-6 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.588476 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] control_exchange = nova {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.588928 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cpu_allocation_ratio = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.589353 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] daemon = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.589798 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] debug = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.590222 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] default_access_ip_network_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.590698 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] default_availability_zone = nova {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.591086 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] default_ephemeral_format = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.591706 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.593834 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] default_schedule_zone = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.594574 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] disk_allocation_ratio = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.595284 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] enable_new_services = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.596370 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] enabled_apis = ['osapi_compute'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.597184 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] enabled_ssl_apis = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.597896 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] flat_injected = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.601212 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] force_config_drive = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.601212 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] force_raw_images = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.601212 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] graceful_shutdown_timeout = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.601212 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] heal_instance_info_cache_interval = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.603572 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_db.sqlalchemy.engines [None req-20fdf692-0533-4c05-ba43-288824a63727 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110966) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:20:24.603907 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] host = n-d-850468-6 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.604362 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] initial_cpu_allocation_ratio = 16.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.604764 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] initial_disk_allocation_ratio = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.605196 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] initial_ram_allocation_ratio = 1.5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.605762 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.606755 n-d-850468-6 nova-conductor[110967]: INFO dbcounter [None req-c7a58e93-90bc-48ec-8337-627b59256c04 None None] Registered counter for database nova_cell0 Jul 28 10:20:24.607930 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] instance_build_timeout = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.608482 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] instance_delete_interval = 300 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.610293 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] instance_format = [instance: %(uuid)s] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.610720 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] instance_name_template = instance-%08x {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.611162 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] instance_usage_audit = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.612319 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] instance_usage_audit_period = month {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.612790 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.613235 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] instances_path = /opt/stack/data/nova/instances {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.613659 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] internal_service_availability_zone = internal {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.617755 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writer thread running {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:20:24.618841 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] key = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.619299 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] live_migration_retry_count = 30 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.619748 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] log_config_append = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.620206 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.620613 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] log_dir = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.621054 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] log_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.621393 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] log_options = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.621820 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] log_rotate_interval = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.622282 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] log_rotate_interval_type = days {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.622688 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] log_rotation_type = none {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.623027 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.623363 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.623773 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.624215 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.624545 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.624992 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] long_rpc_timeout = 1800 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.625392 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] max_concurrent_builds = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.625783 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] max_concurrent_live_migrations = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.626217 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] max_concurrent_snapshots = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.626633 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] max_local_block_devices = 3 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.627592 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] max_logfile_count = 30 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.628100 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] max_logfile_size_mb = 200 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.628601 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] maximum_instance_delete_attempts = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.629031 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] metadata_listen = 0.0.0.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.629493 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] metadata_listen_port = 8775 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.635102 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a58e93-90bc-48ec-8337-627b59256c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110967) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:20:24.642417 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writer thread running {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:20:24.646054 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] metadata_workers = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.646629 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] migrate_max_retries = -1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.647203 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] mkisofs_cmd = genisoimage {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.647562 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] my_block_storage_ip = 10.222.0.46 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.647899 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] my_ip = 10.222.0.46 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.648296 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] network_allocate_retries = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.648739 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.649159 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] osapi_compute_listen = 0.0.0.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.649567 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] osapi_compute_listen_port = 8774 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.649998 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] osapi_compute_unique_server_name_scope = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.650393 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] osapi_compute_workers = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.650776 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] password_length = 12 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.651163 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] periodic_enable = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.651565 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] periodic_fuzzy_delay = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.651968 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] pointer_model = usbtablet {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.652712 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] preallocate_images = none {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.652828 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] publish_errors = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.653079 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] pybasedir = /opt/stack/nova {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.653443 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ram_allocation_ratio = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.653822 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] rate_limit_burst = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.662460 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] rate_limit_except_level = CRITICAL {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.662890 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] rate_limit_interval = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.663306 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] reboot_timeout = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.663968 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] reclaim_instance_interval = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.664374 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] record = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.664748 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] report_interval = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.665136 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] rescue_timeout = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.665949 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] reserved_host_cpus = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.674447 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] reserved_host_disk_mb = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.674970 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] reserved_host_memory_mb = 512 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.675461 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] reserved_huge_pages = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.675877 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] resize_confirm_window = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.676375 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] resize_fs_using_block_device = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.676719 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] resume_guests_state_on_host_boot = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.677153 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.677538 n-d-850468-6 nova-conductor[110966]: DEBUG nova.service [None req-20fdf692-0533-4c05-ba43-288824a63727 None None] Creating RPC server for service conductor {{(pid=110966) start /opt/stack/nova/nova/service.py:182}} Jul 28 10:20:24.677647 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] rpc_response_timeout = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.677990 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] run_external_periodic_tasks = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.678415 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] running_deleted_instance_action = reap {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.678796 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] running_deleted_instance_poll_interval = 1800 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.679198 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] running_deleted_instance_timeout = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.679581 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler_instance_sync_interval = 120 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.679966 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_down_time = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.680400 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] servicegroup_driver = db {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.680789 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] shelved_offload_time = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.681180 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] shelved_poll_interval = 3600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.681593 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] shutdown_timeout = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.681998 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] source_is_ipv6 = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.682374 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ssl_only = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.682767 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] state_path = /opt/stack/data/nova {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.683172 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] sync_power_state_interval = 600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.683558 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] sync_power_state_pool_size = 1000 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.683960 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] syslog_log_facility = LOG_USER {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.684344 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] tempdir = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.684727 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] timeout_nbd = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.685148 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] transport_url = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.685534 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] update_resources_interval = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.685949 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] use_cow_images = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.686334 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] use_eventlog = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.686724 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] use_journal = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.687103 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] use_json = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.687484 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] use_rootwrap_daemon = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.687870 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] use_stderr = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.688253 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] use_syslog = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.688628 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vcpu_pin_set = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.689022 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vif_plugging_is_fatal = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.689507 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vif_plugging_timeout = 300 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.690179 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] virt_mkfs = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.690573 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] volume_usage_poll_interval = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.690962 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] watch_log_file = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.691377 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] web = /usr/share/spice-html5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:20:24.691903 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_concurrency.disable_process_locking = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.692342 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.692790 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.693179 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.693581 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.694020 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.694421 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.694900 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.auth_strategy = keystone {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.695099 n-d-850468-6 nova-conductor[110967]: DEBUG nova.service [None req-c7a58e93-90bc-48ec-8337-627b59256c04 None None] Creating RPC server for service conductor {{(pid=110967) start /opt/stack/nova/nova/service.py:182}} Jul 28 10:20:24.695306 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.compute_link_prefix = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.695733 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.696141 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.dhcp_domain = novalocal {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.696542 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.enable_instance_password = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.696933 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.glance_link_prefix = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.697323 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.697719 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.698141 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.instance_list_per_project_cells = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.698525 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.list_records_by_skipping_down_cells = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.698909 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.local_metadata_per_cell = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.699320 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.max_limit = 1000 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.699733 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.metadata_cache_expiration = 15 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.700136 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.neutron_default_tenant_id = default {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.700532 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.use_forwarded_for = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.700924 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.use_neutron_default_nets = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.701312 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.701690 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.702154 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.702689 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.vendordata_dynamic_ssl_certfile = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.703179 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.vendordata_dynamic_targets = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.703578 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.vendordata_jsonfile_path = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.704001 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api.vendordata_providers = ['StaticJSON'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.704522 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.backend = dogpile.cache.memcached {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.704949 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.backend_argument = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.705906 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.config_prefix = cache.oslo {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.706313 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.dead_timeout = 60.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.706734 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.debug_cache_backend = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.707123 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.enable_retry_client = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.707510 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.enable_socket_keepalive = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.707928 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.enabled = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.708321 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.expiration_time = 600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.708710 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.hashclient_retry_attempts = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.709106 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.hashclient_retry_delay = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.709511 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.memcache_dead_retry = 300 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.709926 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.710323 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.710696 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.memcache_pool_maxsize = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.711090 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.711491 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.711881 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.memcache_socket_timeout = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.712285 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.proxies = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.712665 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.retry_attempts = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.713050 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.retry_delay = 0.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.713450 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.socket_keepalive_count = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.713848 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.socket_keepalive_idle = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.714250 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.socket_keepalive_interval = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.714874 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.tls_allowed_ciphers = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.715256 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.tls_cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.715650 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.tls_certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.716036 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.tls_enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.716412 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cache.tls_keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.716847 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.auth_section = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.717244 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.auth_type = password {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.717625 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.718082 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.catalog_info = volumev3::publicURL {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.718465 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.718846 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.719326 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.cross_az_attach = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.719738 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.debug = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.720215 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.endpoint_template = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.720756 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.http_retries = 3 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.721676 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.722607 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.723208 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.os_region_name = RegionOne {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.723746 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.724128 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cinder.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.724530 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.724914 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.cpu_dedicated_set = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.725320 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.cpu_shared_set = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.725708 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.image_type_exclude_list = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.726120 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.726518 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.max_concurrent_disk_ops = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.726892 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.max_disk_devices_to_attach = -1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.727435 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.727840 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.728232 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.resource_provider_association_refresh = 300 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.728636 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] compute.shutdown_retry_interval = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.729041 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] conductor.workers = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.729443 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] console.allowed_origins = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.729829 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] console.ssl_ciphers = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.730264 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] console.ssl_minimum_version = default {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.730669 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] consoleauth.token_ttl = 600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.731081 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.731458 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.731841 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.732219 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.connect_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.732601 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.connect_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.732980 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.endpoint_override = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.733359 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.733733 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.734146 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.max_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.734531 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.min_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.734907 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.region_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.735286 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.service_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.735694 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.service_type = accelerator {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.736089 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.737042 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.status_code_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.737042 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.status_code_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.737303 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.737919 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.738273 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] cyborg.version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.738716 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.backend = sqlalchemy {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.739109 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.connection = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.739646 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.connection_debug = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.741811 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.connection_parameters = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.742410 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.connection_recycle_time = 3600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.742820 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.connection_trace = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.743216 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.db_inc_retry_interval = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.743606 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.db_max_retries = 20 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.743991 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.db_max_retry_interval = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.744378 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.db_retry_interval = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.744797 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.max_overflow = 50 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.745177 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.max_pool_size = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.745607 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.max_retries = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.748514 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.mysql_enable_ndb = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.749137 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.752392 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.pool_timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.753397 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.retry_interval = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.753397 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.slave_connection = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.753754 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.sqlite_synchronous = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.755607 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] database.use_db_reconnect = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.756215 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.backend = sqlalchemy {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.756814 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.connection = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.757400 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.connection_debug = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.758036 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.connection_parameters = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.758612 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.connection_recycle_time = 3600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.759198 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.connection_trace = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.764542 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.db_inc_retry_interval = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.765206 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.db_max_retries = 20 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.766696 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.db_max_retry_interval = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.767599 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.db_retry_interval = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.769711 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.max_overflow = 50 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.770324 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.max_pool_size = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.771438 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.max_retries = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.771547 n-d-850468-6 nova-conductor[110966]: DEBUG nova.service [None req-20fdf692-0533-4c05-ba43-288824a63727 None None] Join ServiceGroup membership for this service conductor {{(pid=110966) start /opt/stack/nova/nova/service.py:199}} Jul 28 10:20:24.772131 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.mysql_enable_ndb = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.772237 n-d-850468-6 nova-conductor[110966]: DEBUG nova.servicegroup.drivers.db [None req-20fdf692-0533-4c05-ba43-288824a63727 None None] DB_Driver: join new ServiceGroup member n-d-850468-6 to the conductor group, service = {{(pid=110966) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jul 28 10:20:24.772819 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.773372 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.pool_timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.774824 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.retry_interval = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.776278 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.slave_connection = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.780118 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] api_database.sqlite_synchronous = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.781322 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] devices.enabled_mdev_types = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.781726 n-d-850468-6 nova-conductor[110967]: DEBUG nova.service [None req-c7a58e93-90bc-48ec-8337-627b59256c04 None None] Join ServiceGroup membership for this service conductor {{(pid=110967) start /opt/stack/nova/nova/service.py:199}} Jul 28 10:20:24.782164 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.782322 n-d-850468-6 nova-conductor[110967]: DEBUG nova.servicegroup.drivers.db [None req-c7a58e93-90bc-48ec-8337-627b59256c04 None None] DB_Driver: join new ServiceGroup member n-d-850468-6 to the conductor group, service = {{(pid=110967) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jul 28 10:20:24.782877 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ephemeral_storage_encryption.enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.783964 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.785056 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.api_servers = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.786096 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.786598 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.787076 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.787555 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.connect_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.788015 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.connect_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.788726 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.debug = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.789237 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.default_trusted_certificate_ids = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.789697 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.enable_certificate_validation = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.790184 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.enable_rbd_download = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.790626 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.endpoint_override = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.791085 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.791554 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.792013 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.max_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.792483 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.min_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.792933 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.num_retries = 3 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.793399 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.rbd_ceph_conf = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.793874 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.rbd_connect_timeout = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.794365 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.rbd_pool = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.794831 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.rbd_user = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.795273 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.region_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.795714 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.service_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.796176 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.service_type = image {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.796626 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.797086 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.status_code_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.797547 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.status_code_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.798039 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.798496 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.799517 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.verify_glance_signatures = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.800124 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] glance.version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.800754 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] guestfs.debug = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.801388 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.config_drive_cdrom = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.802028 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.config_drive_inject_password = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.802637 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.803086 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.enable_instance_metrics_collection = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.803553 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.enable_remotefx = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.804011 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.instances_path_share = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.804480 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.iscsi_initiator_list = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.804925 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.limit_cpu_features = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.805380 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.805825 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.806340 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.power_state_check_timeframe = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.806784 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.807240 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.807695 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.use_multipath_io = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.808143 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.volume_attach_retry_count = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.808604 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.809043 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.vswitch_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.809489 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.809991 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] mks.enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.811096 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.811584 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] image_cache.manager_interval = 2400 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.812037 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] image_cache.precache_concurrency = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.812493 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] image_cache.remove_unused_base_images = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.812952 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.813406 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.814281 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] image_cache.subdirectory_name = _base {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.814502 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.api_max_retries = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.815240 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.api_retry_interval = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.815669 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.auth_section = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.816114 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.auth_type = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.816557 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.817006 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.817459 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.817934 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.connect_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.818469 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.connect_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.818853 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.endpoint_override = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.819253 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.819643 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.820027 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.max_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.820421 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.min_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.820788 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.partition_key = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.821192 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.peer_list = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.821572 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.region_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.821985 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.serial_console_state_timeout = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.822368 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.service_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.822765 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.service_type = baremetal {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.823152 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.823532 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.status_code_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.823916 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.status_code_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.824301 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.824713 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.825091 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ironic.version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.825514 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.826067 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] key_manager.fixed_key = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.826544 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.826924 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.barbican_api_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.827322 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.barbican_endpoint = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.827763 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.barbican_endpoint_type = public {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.828162 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.barbican_region_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.828611 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.829005 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.829391 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.829774 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.830243 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.830828 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.number_of_retries = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.831104 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.retry_delay = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.831481 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.send_service_user_token = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.831866 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.832240 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.832623 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.verify_ssl = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.833018 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican.verify_ssl_path = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.833431 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican_service_user.auth_section = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.833813 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican_service_user.auth_type = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.834217 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican_service_user.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.834597 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican_service_user.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.834978 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican_service_user.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.835360 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican_service_user.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.835739 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican_service_user.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.836124 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican_service_user.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.836494 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] barbican_service_user.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.836903 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.approle_role_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.837303 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.approle_secret_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.837679 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.838094 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.838479 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.838868 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.839243 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.839638 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.kv_mountpoint = secret {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.840018 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.kv_version = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.840394 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.namespace = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.840774 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.root_token_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.841154 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.841527 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.ssl_ca_crt_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.841944 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.842326 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.use_ssl = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.842962 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.843150 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.843524 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.843908 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.844287 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.connect_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.844664 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.connect_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.845036 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.endpoint_override = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.845434 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.846371 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.846819 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.max_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.847374 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.min_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.847754 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.region_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.848133 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.service_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.848580 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.service_type = identity {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.848970 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.849350 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.status_code_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.849725 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.status_code_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.850138 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.850555 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.850932 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] keystone.version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.851460 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.connection_uri = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.851872 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.cpu_mode = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.852336 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.cpu_model_extra_flags = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.853344 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.cpu_models = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.853344 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.device_detach_attempts = 8 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.853703 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.device_detach_timeout = 20 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.853980 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.disk_cachemodes = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.854365 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.disk_prefix = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.854781 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.enabled_perf_events = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.855196 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.file_backed_memory = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.855615 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.gid_maps = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.856025 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.hw_disk_discard = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.856563 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.hw_machine_type = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.856986 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.images_rbd_ceph_conf = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.857380 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.857781 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.858217 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.images_rbd_glance_store_name = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.858610 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.images_rbd_pool = rbd {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.859026 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.images_type = default {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.859402 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.images_volume_group = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.859782 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.inject_key = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.860197 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.inject_partition = -2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.860593 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.inject_password = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.860990 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.iscsi_iface = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.862463 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.iser_use_multipath = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.862642 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_bandwidth = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.863117 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.863338 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_downtime = 500 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.863720 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.864100 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.864484 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_inbound_addr = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.864865 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.865256 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_permit_post_copy = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.865630 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_scheme = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.866059 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_timeout_action = abort {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.866695 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_tunnelled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.867077 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_uri = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.867458 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.live_migration_with_native_tls = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.867854 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.max_queues = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.868271 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.868616 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.nfs_mount_options = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.869135 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.869550 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.869994 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.num_iser_scan_tries = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.870386 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.num_memory_encrypted_guests = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.870795 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.871217 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.num_pcie_ports = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.871642 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.num_volume_scan_tries = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.872118 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.pmem_namespaces = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.872501 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.quobyte_client_cfg = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.873286 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.873454 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rbd_connect_timeout = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.873813 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.874345 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.874837 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rbd_secret_uuid = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.875328 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rbd_user = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.875822 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.876342 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.remote_filesystem_transport = ssh {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.876856 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rescue_image_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.877498 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rescue_kernel_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.877987 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rescue_ramdisk_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.878510 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rng_dev_path = /dev/urandom {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.879005 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.rx_queue_size = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.879552 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.smbfs_mount_options = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.880166 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.880666 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.snapshot_compression = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.881156 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.snapshot_image_format = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.881765 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.882295 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.sparse_logical_volumes = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.882795 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.swtpm_enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.883436 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.swtpm_group = tss {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.883818 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.swtpm_user = tss {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.884327 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.sysinfo_serial = unique {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.884815 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.tx_queue_size = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.885339 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.uid_maps = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.885837 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.use_virtio_for_bridges = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.886369 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.virt_type = kvm {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.886879 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.volume_clear = zero {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.887388 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.volume_clear_size = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.887901 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.volume_use_multipath = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.888390 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.vzstorage_cache_path = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.888954 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.889657 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.vzstorage_mount_group = qemu {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.890371 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.vzstorage_mount_opts = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.890911 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.891400 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.891797 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.vzstorage_mount_user = stack {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.892183 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.893088 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.auth_section = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.893088 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.auth_type = password {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.893756 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.893961 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.894236 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.894612 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.connect_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.894993 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.connect_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.895418 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.default_floating_pool = public {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.895765 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.endpoint_override = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.896147 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.extension_sync_interval = 600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.896533 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.http_retries = 3 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.896913 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.897292 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.897665 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.max_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.898104 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.898480 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.min_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.898869 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.ovs_bridge = br-int {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.899272 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.physnets = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.899661 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.region_name = RegionOne {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.900048 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.service_metadata_proxy = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.900419 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.service_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.900813 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.service_type = network {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.901191 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.901563 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.status_code_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.901957 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.status_code_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.902332 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.902739 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.903136 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] neutron.version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.903572 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] notifications.bdms_in_notifications = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.903974 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] notifications.default_level = INFO {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.904338 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] notifications.notification_format = unversioned {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.904720 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] notifications.notify_on_state_change = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.905156 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.905569 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] pci.alias = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.906001 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] pci.device_spec = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.906386 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] pci.report_in_placement = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.906811 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.auth_section = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.907201 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.auth_type = password {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.909360 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.auth_url = http://10.222.0.46/identity {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.909360 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.909360 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.909360 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.910117 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.connect_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.910117 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.connect_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.910507 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.default_domain_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.910881 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.default_domain_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.911276 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.domain_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.911628 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.domain_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.912000 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.endpoint_override = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.912377 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.912757 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.913115 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.max_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.913743 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.min_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.914173 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.password = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.914533 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.project_domain_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.914917 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.project_domain_name = Default {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.915303 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.project_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.915707 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.project_name = service {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.916112 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.region_name = RegionOne {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.916524 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.service_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.916918 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.service_type = placement {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.917324 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.918066 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.status_code_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.918227 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.status_code_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.918465 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.system_scope = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.918907 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.919213 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.trust_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.919584 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.user_domain_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.919975 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.user_domain_name = Default {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.920349 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.user_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.920752 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.username = placement {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.921160 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.921533 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] placement.version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.921976 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] powervm.disk_driver = localdisk {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.922389 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] powervm.proc_units_factor = 0.1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.922781 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] powervm.volume_group_name = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.923182 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.cores = 20 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.923566 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.count_usage_from_placement = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.924683 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.924683 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.injected_file_content_bytes = 10240 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.924997 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.injected_file_path_length = 255 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.925343 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.injected_files = 5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.925740 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.instances = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.926136 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.key_pairs = 100 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.926525 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.metadata_items = 128 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.926911 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.ram = 51200 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.927290 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.recheck_quota = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.927695 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.server_group_members = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.928077 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] quota.server_groups = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.928462 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] rdp.enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.929070 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.929476 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.929920 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.930328 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.image_metadata_prefilter = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.930738 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.931148 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.max_attempts = 3 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.931535 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.max_placement_results = 1000 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.931932 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.932359 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.query_placement_for_availability_zone = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.932775 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.query_placement_for_image_type_support = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.933189 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.933602 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] scheduler.workers = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.934044 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.934445 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.934875 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.935261 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.935671 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.936053 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.936435 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.936863 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.937314 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.host_subset_size = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.937620 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.938046 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.938460 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.isolated_hosts = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.938844 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.isolated_images = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.939243 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.940444 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.940793 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.941175 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.941580 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.941985 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.942389 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.942775 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.943180 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.track_instance_changes = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.944093 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.944093 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] metrics.required = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.944540 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] metrics.weight_multiplier = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.944786 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] metrics.weight_of_unavailable = -10000.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.945126 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] metrics.weight_setting = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.945650 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.946057 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] serial_console.enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.946478 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] serial_console.port_range = 10000:20000 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.946870 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.947259 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.947638 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] serial_console.serialproxy_port = 6083 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.948018 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.auth_section = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.948408 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.auth_type = password {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.948779 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.949161 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.949526 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.949919 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.950292 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.950679 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.send_service_user_token = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.951056 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.951425 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] service_user.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.951841 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] spice.agent_enabled = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.952218 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] spice.enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.952829 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.953280 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] spice.html5proxy_host = 0.0.0.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.953658 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] spice.html5proxy_port = 6082 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.954106 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] spice.server_listen = 127.0.0.1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.954551 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.954910 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] upgrade_levels.baseapi = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.956095 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] upgrade_levels.cert = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.956474 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] upgrade_levels.compute = auto {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.956646 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] upgrade_levels.conductor = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.956933 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] upgrade_levels.scheduler = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.957359 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vendordata_dynamic_auth.auth_section = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.957739 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vendordata_dynamic_auth.auth_type = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.958139 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vendordata_dynamic_auth.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.958514 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vendordata_dynamic_auth.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.958892 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.959274 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vendordata_dynamic_auth.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.959643 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vendordata_dynamic_auth.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.960070 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.960416 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vendordata_dynamic_auth.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.960860 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.api_retry_count = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.961233 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.ca_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.961621 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.cache_prefix = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.962040 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.cluster_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.962419 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.connection_pool_size = 10 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.962790 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.console_delay_seconds = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.963158 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.datastore_regex = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.963529 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.host_ip = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.963898 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.host_password = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.964273 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.host_port = 443 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.964662 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.host_username = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.965021 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.965394 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.integration_bridge = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.965793 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.maximum_objects = 100 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.966222 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.pbm_default_policy = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.966584 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.pbm_enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.966952 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.pbm_wsdl_location = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.967341 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.967785 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.serial_port_proxy_uri = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.968082 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.serial_port_service_uri = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.969045 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.task_poll_interval = 0.5 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.969045 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.use_linked_clone = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.969362 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.vnc_keymap = en-us {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.969593 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.vnc_port = 5900 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.969994 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vmware.vnc_port_total = 10000 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.970451 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.auth_schemes = ['none'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.971000 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.enabled = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.971550 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.971957 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.972348 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.novncproxy_port = 6080 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.972767 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.server_listen = 127.0.0.1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.973165 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.973540 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.vencrypt_ca_certs = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.973941 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.vencrypt_client_cert = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.974316 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] vnc.vencrypt_client_key = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.974779 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.975107 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.975486 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.disable_group_policy_check_upcall = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.975869 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.976378 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.disable_rootwrap = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.976660 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.enable_numa_live_migration = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.977017 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.977396 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.977772 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.978179 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.libvirt_disable_apic = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.978559 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.978936 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.979314 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.979698 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.980071 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.980459 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.980869 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.981252 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.client_socket_timeout = 900 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.981635 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.default_pool_size = 1000 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.982050 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.keep_alive = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.982442 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.max_header_line = 16384 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.982817 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.secure_proxy_ssl_header = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.983195 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.ssl_ca_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.983572 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.ssl_cert_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.983954 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.ssl_key_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.984357 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.tcp_keepidle = 600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.984757 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.985138 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] zvm.ca_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.985509 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] zvm.cloud_connector_url = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.986026 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.987033 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] zvm.reachable_timeout = 300 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.987033 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.enforce_new_defaults = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.987405 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.enforce_scope = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.987824 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.policy_default_rule = default {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.988262 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.988656 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.policy_file = policy.yaml {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.989089 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.989481 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.989870 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.990271 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.990649 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.991061 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.991689 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.991886 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.connection_string = messaging:// {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.992295 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.enabled = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.992700 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.es_doc_type = notification {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.993097 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.es_scroll_size = 10000 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.993487 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.es_scroll_time = 2m {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.993891 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.filter_error_trace = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.994276 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.hmac_keys = SECRET_KEY {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.994665 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.sentinel_service_name = mymaster {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.995073 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.socket_timeout = 0.1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.995449 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] profiler.trace_sqlalchemy = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.995880 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] remote_debug.host = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.996275 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] remote_debug.port = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.996695 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.997187 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.997459 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.997834 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.998244 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.998617 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.999005 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.999404 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:24.999800 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.000771 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.000771 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.001298 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.001298 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.001700 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.002964 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.003145 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.003441 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.003829 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.004208 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.005421 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.005421 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.005421 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.005852 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.006102 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.006496 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.006903 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.ssl = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.007300 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.007691 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.008071 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.008462 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.008850 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_rabbit.ssl_version = {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.009279 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.009662 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_notifications.retry = -1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.010116 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.010512 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_messaging_notifications.transport_url = **** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.011002 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.auth_section = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.011307 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.auth_type = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.011684 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.cafile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.012057 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.certfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.012434 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.collect_timing = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.012807 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.connect_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.013175 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.connect_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.013547 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.endpoint_id = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.013946 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.endpoint_override = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.014327 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.insecure = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.014704 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.keyfile = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.015073 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.max_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.015449 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.min_version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.015813 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.region_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.016217 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.service_name = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.016551 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.service_type = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.016926 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.split_loggers = False {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.017298 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.status_code_retries = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.018331 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.status_code_retry_delay = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.018643 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.timeout = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.019013 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.valid_interfaces = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.019390 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_limit.version = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.019807 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_reports.file_event_handler = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.020193 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.020583 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] oslo_reports.log_dir = None {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:20:25.020898 n-d-850468-6 nova-conductor[110080]: DEBUG oslo_service.service [None req-88d33acb-d2bf-4fda-bd63-e0360156943f None None] ******************************************************************************** {{(pid=110080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 10:20:34.385375 n-d-850468-6 nova-conductor[110080]: DEBUG dbcounter [-] [110080] Writing DB stats nova_api:SELECT=3 {{(pid=110080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:34.547428 n-d-850468-6 nova-conductor[110080]: DEBUG dbcounter [-] [110080] Writing DB stats nova_cell0:SELECT=3 {{(pid=110080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:34.553491 n-d-850468-6 nova-conductor[110080]: DEBUG dbcounter [-] [110080] Writing DB stats nova_cell1:SELECT=3 {{(pid=110080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:59.776619 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=15,nova_cell0:INSERT=1,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:59.792520 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=1,nova_cell0:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:21:29.785272 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=5 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:21:39.772070 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:22:09.779507 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:22:09.780719 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:22:29.784757 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:22:49.783576 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:UPDATE=4,nova_cell0:SELECT=7 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:23:09.782288 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:23:29.788391 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:23:39.795978 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:24:09.800386 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:24:19.801147 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:24:49.809621 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:24:59.804241 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:25:29.816775 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:25:39.814551 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:26:09.818884 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:26:19.819649 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:26:49.821599 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:26:59.821572 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:27:29.824838 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:27:39.826615 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:28:09.826780 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:28:19.828612 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:28:49.829581 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:28:59.828765 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:29:09.835324 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:29:29.837844 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:29:49.842164 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:09.845400 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:17.365234 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_db.sqlalchemy.engines [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Parent process 110080 forked (110966) with an open database connection, which is being discarded and recreated. {{(pid=110966) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Jul 28 10:30:17.373908 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writer thread running {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:30:17.382741 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:30:18.169960 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:18.171195 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:18.206985 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:18.209787 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:18.215024 n-d-850468-6 nova-conductor[110966]: INFO dbcounter [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Registered counter for database nova_cell0 Jul 28 10:30:18.225031 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_db.sqlalchemy.engines [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110966) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:30:18.234117 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writer thread running {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:30:18.585106 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:30:18.591575 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:18.592060 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:18.614784 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:30:18.614784 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:30:18.614784 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:18.614784 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:30:18.614784 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:18.614784 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:30:18.614784 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:18.614784 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:18.619343 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:19.056605 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_db.sqlalchemy.engines [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Parent process 110080 forked (110967) with an open database connection, which is being discarded and recreated. {{(pid=110967) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Jul 28 10:30:19.066841 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writer thread running {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:30:19.077563 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:30:19.376274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:19.377320 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:19.440493 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:19.458736 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:19.470718 n-d-850468-6 nova-conductor[110967]: INFO dbcounter [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Registered counter for database nova_cell0 Jul 28 10:30:19.486559 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_db.sqlalchemy.engines [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110967) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:30:19.495960 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writer thread running {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:30:19.779559 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:30:19.784509 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:19.785297 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:19.812710 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:30:19.812710 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:30:19.812710 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:19.812710 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:30:19.812710 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:19.812710 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:30:19.812710 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:19.812710 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:19.816464 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:19.851431 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:19.909505 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:30:20.732912 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:20.734601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:20.757903 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:20.757903 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:20.915879 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:30:20.917331 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:20.917966 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:20.929136 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:30:20.929136 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:30:20.929136 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:20.929136 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:30:20.929136 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:20.929136 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:30:20.929136 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:20.929136 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:20.931287 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:30:23.580815 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:23.582459 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:23.596426 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.596842 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.700717 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:30:23.702540 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.703139 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.710531 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:30:23.710531 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:30:23.710531 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:23.710531 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:30:23.710531 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:23.710531 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:30:23.710531 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:23.710531 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:23.714988 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:30:24.337452 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:24.338884 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:24.355412 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.356313 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.377244 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=41,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=47,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:24.486121 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:30:24.487835 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.488628 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.504343 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:30:24.504343 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:30:24.504343 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:24.504343 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:30:24.504343 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:24.504343 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:30:24.504343 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:24.504343 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:24.506951 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:30:31.886193 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:31.888079 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:31.914600 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:31.915501 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:31.954482 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=38,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=52,nova_cell0:RELEASE=1,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:32.095013 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:30:32.096911 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:32.097536 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:32.109643 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:30:32.109643 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:30:32.109643 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:32.109643 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:30:32.109643 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:32.109643 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:30:32.109643 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:32.109643 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:32.112360 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:34.556617 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:INSERT=13,nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:34.573786 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:34.574942 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:42.021966 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:42.167503 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:INSERT=6,nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:42.206387 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:30:50.900049 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:50.902465 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:30:50.928109 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:50.929072 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:51.113619 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:30:51.116109 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:51.116732 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:51.151413 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:30:51.151413 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:30:51.151413 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:51.151413 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:30:51.151413 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:51.151413 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:30:51.151413 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:51.151413 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:51.154775 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:30:57.308257 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:57.311234 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:30:57.362535 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:57.363992 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:57.499262 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:30:57.500536 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:57.500950 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:57.511531 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:30:57.511531 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:30:57.511531 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:30:57.511531 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:30:57.511531 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:30:57.511531 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:30:57.511531 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:30:57.511531 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:57.512500 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:30:59.853757 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:59.917620 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:01.219185 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:01.248422 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:31:01.304580 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:01.305958 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:01.363305 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:01.364173 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:01.564011 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:31:01.566601 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:01.567350 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:01.586759 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:31:01.586759 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:31:01.586759 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:01.586759 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:31:01.586759 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:01.586759 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:31:01.586759 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:01.586759 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:01.588955 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:31:04.436963 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:04.438996 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:04.477733 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:04.485563 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:04.639664 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:31:04.641436 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:04.643212 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:04.658872 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:31:04.658872 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:31:04.658872 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:04.658872 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:31:04.658872 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:04.658872 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:31:04.658872 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:04.658872 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:04.660306 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:31:04.839699 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:04.841367 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:04.854517 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:04.854930 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.009101 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:31:05.012583 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.013983 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.041594 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:31:05.041594 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:31:05.041594 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:05.041594 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:31:05.041594 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:05.041594 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:31:05.041594 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:05.041594 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:05.044218 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:14.583182 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:14.714090 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=34,nova_cell0:INSERT=38,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:14.729710 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:14.937185 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:15.113047 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:INSERT=39,nova_cell0:UPDATE=8,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:15.136162 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:19.858653 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:19.924617 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:31:28.144238 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:28.147318 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:31:28.206082 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:28.206982 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:28.393706 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:31:28.403283 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:28.403543 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:28.430066 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:31:28.430066 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:31:28.430066 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:28.430066 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:31:28.430066 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:28.430066 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:31:28.430066 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:28.430066 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:28.437267 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:38.547451 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:38.562768 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:38.566849 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:31:57.440232 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:57.444023 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:31:57.468171 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:57.469452 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:57.742025 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:31:57.743561 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:57.743991 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:57.757775 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:31:57.757775 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:31:57.757775 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:31:57.757775 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:31:57.757775 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:31:57.757775 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:31:57.757775 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:31:57.757775 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:57.759035 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:31:59.861394 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:59.924211 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:06.614073 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:06.617099 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:06.657413 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.658065 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.822030 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:06.823194 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.827206 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.839236 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:06.839236 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:06.839236 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:06.839236 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:06.839236 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:06.839236 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:06.839236 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:06.839236 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:06.841027 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:07.823919 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:07.856426 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:07.857801 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:08.304675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:08.305775 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:08.320236 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:08.320654 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:08.527060 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:08.528972 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:08.530313 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:08.545738 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:08.545738 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:08.545738 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:08.545738 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:08.545738 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:08.545738 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:08.545738 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:08.545738 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:08.547994 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:09.828102 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:09.829926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:09.849143 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:09.852620 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:10.007761 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:10.012436 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:10.014168 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:10.027780 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:10.027780 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:10.027780 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:10.027780 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:10.027780 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:10.027780 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:10.027780 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:10.027780 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:10.029090 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:11.514844 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:11.517574 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:11.542480 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:11.542907 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:11.777467 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:11.780959 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:11.782367 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:11.805803 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:11.805803 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:11.805803 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:11.805803 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:11.805803 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:11.805803 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:11.805803 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:11.805803 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:11.810562 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:19.951591 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:20.070197 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=39,nova_cell0:RELEASE=1,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:20.087992 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:21.540543 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=9 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:21.903633 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=40,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:21.924230 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:23.468784 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:23.471551 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:23.495746 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:23.496163 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:23.730622 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:23.732339 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:23.732956 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:23.755035 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:23.755035 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:23.755035 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:23.755035 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:23.755035 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:23.755035 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:23.755035 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:23.755035 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:23.760719 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:25.927278 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:25.928920 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:25.955917 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:25.956454 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:26.099614 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:26.102588 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:26.138279 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.139184 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.212701 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:26.214100 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.214521 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.237590 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:26.237590 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:26.237590 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:26.237590 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:26.237590 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:26.237590 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:26.237590 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:26.237590 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:26.239914 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:26.334024 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] block_device_mapping [BlockDeviceMapping(attachment_id=a7cf9317-a30f-449b-aff0-de5e2eec4103,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa85c6e2-453f-4494-9ded-cf4e1ddd89dd',volume_size=1,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:26.336045 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.336610 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.357745 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:26.357745 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:26.357745 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:26.357745 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:26.357745 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:26.357745 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:26.357745 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:26.357745 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:26.361414 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:34.461728 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:34.463426 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:34.491651 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:34.493743 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:34.753481 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:34.755362 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:34.755981 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:34.770466 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:34.770466 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:34.770466 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:34.770466 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:34.770466 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:34.770466 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:34.770466 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:34.770466 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:34.773163 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:36.148095 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:36.149893 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:32:36.178989 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:36.181243 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:36.242483 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=53,nova_cell0:RELEASE=1,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:36.359678 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:36.363206 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:36.363733 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:36.382640 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:36.382640 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:32:36.382640 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:36.382640 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:32:36.382640 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:36.382640 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:32:36.382640 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:36.382640 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:36.385761 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:32:39.067710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:39.069142 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:32:39.096639 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:39.097073 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:39.217425 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=3,nova_cell0:INSERT=49,nova_cell0:RELEASE=3,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:39.369626 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:32:39.371985 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:39.373092 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:39.395223 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:32:39.395223 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:32:39.395223 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:32:39.395223 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:32:39.395223 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:32:39.395223 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:32:39.395223 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:32:39.395223 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:39.399951 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:32:39.866865 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:39.927811 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=7 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:46.468790 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=14,nova_cell0:INSERT=4,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:46.491613 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:46.494717 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:49.289344 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:49.470337 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:INSERT=11,nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:49.493964 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:33:11.225037 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:11.226833 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:11.244442 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:11.245936 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:11.435178 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:33:11.440830 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:11.441690 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:11.485936 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:33:11.485936 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:33:11.485936 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:11.485936 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:33:11.485936 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:11.485936 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:33:11.485936 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:11.485936 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:11.487430 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:33:14.309264 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:14.310968 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:14.335160 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:14.335825 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:14.520630 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:33:14.524047 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:14.525174 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:14.562456 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:33:14.562456 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:33:14.562456 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:14.562456 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:33:14.562456 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:14.562456 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:33:14.562456 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:14.562456 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:14.567478 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:33:19.506400 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:19.508216 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:19.532031 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:19.532448 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:19.676781 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:33:19.678715 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:19.679690 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:19.692748 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:33:19.692748 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:33:19.692748 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:19.692748 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:33:19.692748 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:19.692748 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:33:19.692748 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:19.692748 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:19.695294 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:19.869069 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:19.924286 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:33:20.167014 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:20.168187 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:20.193820 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.194640 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.406229 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:33:20.407991 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.408625 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.436036 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:33:20.436036 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:33:20.436036 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:20.436036 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:33:20.436036 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:20.436036 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:33:20.436036 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:20.436036 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:20.438174 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:33:28.982677 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:28.984276 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:29.012692 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:29.013220 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:29.087320 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=51,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:29.282861 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:33:29.284830 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:29.285381 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:29.316446 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:33:29.316446 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:33:29.316446 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:29.316446 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:33:29.316446 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:29.316446 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:33:29.316446 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:29.316446 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:29.322292 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:30.493735 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=40,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:30.507576 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:30.514082 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:39.179187 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:39.392744 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:INSERT=8,nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:39.415213 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:33:43.779540 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:43.781782 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:33:43.809126 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:43.809796 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:44.082201 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:33:44.086445 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:44.089008 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:44.122495 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:33:44.122495 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:33:44.122495 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:44.122495 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:33:44.122495 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:44.122495 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:33:44.122495 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:44.122495 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:44.124629 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:54.194269 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=21,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:54.211614 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:54.214015 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:33:58.366034 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:58.367743 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:33:58.393816 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:58.396141 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:58.609528 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:33:58.611510 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:58.612165 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:58.625436 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:33:58.625436 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:33:58.625436 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:33:58.625436 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:33:58.625436 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:33:58.625436 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:33:58.625436 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:33:58.625436 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:58.628027 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:33:59.876048 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:59.918280 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:08.524824 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:08.737111 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:08.762960 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:39.872385 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:39.919471 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:34:41.445560 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:41.447590 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:41.468807 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:41.471043 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:41.742980 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:34:41.749566 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:41.750341 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:41.770978 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:34:41.770978 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:34:41.770978 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:41.770978 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:34:41.770978 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:41.770978 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:34:41.770978 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:41.770978 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:41.772792 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:34:45.900949 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:45.902668 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:45.923989 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:45.924446 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:46.131954 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:34:46.133527 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:46.134128 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:46.160742 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:34:46.160742 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:34:46.160742 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:46.160742 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:34:46.160742 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:46.160742 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:34:46.160742 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:46.160742 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:46.161751 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:34:46.855691 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:46.857644 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:46.880360 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:46.881485 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:47.035293 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:34:47.037910 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:47.038543 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:47.051525 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:34:47.051525 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:34:47.051525 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:47.051525 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:34:47.051525 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:47.051525 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:34:47.051525 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:47.051525 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:47.054091 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:34:48.766905 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:48.768685 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:48.810586 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.811267 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.966411 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:34:48.969031 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.969671 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:49.013541 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:34:49.013541 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:34:49.013541 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:49.013541 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:34:49.013541 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:49.013541 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:34:49.013541 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:49.013541 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:49.047788 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:34:49.156135 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:49.158000 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:49.173602 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:49.180584 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:49.281541 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=3,nova_cell0:INSERT=49,nova_cell0:RELEASE=3,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:49.428143 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:34:49.431525 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:49.439035 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:49.484351 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:34:49.484351 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:34:49.484351 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:49.484351 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:34:49.484351 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:49.484351 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:34:49.484351 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:49.484351 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:49.485515 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:34:54.736828 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:54.738773 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:54.757157 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:54.757572 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:54.844012 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=3,nova_cell0:INSERT=49,nova_cell0:RELEASE=3,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:55.016731 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eadb7bcd-74e9-426a-b427-eacbfae65980',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:34:55.018895 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:55.019620 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:55.037303 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:34:55.037303 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:34:55.037303 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:55.037303 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:34:55.037303 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:55.037303 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:34:55.037303 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:55.037303 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:55.039395 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:34:57.539674 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:57.542373 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:34:57.564656 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:57.565220 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:57.745555 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:34:57.747854 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:57.748428 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:57.778881 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:34:57.778881 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:34:57.778881 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:57.778881 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:34:57.778881 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:57.778881 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:34:57.778881 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:57.778881 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:57.781436 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:34:58.440174 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:58.442222 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:34:58.478558 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.480100 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.743017 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:34:58.749309 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.752067 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.793813 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:34:58.793813 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:34:58.793813 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:58.793813 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:34:58.793813 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:58.793813 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:34:58.793813 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:58.793813 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:58.796505 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:58.938395 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.943819 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:59.079327 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:INSERT=47,nova_cell0:SELECT=42,nova_cell0:UPDATE=9,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:59.131025 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:34:59.151022 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:59.151560 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:59.187935 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:34:59.187935 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:34:59.187935 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:34:59.187935 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:34:59.187935 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:34:59.187935 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:34:59.187935 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:34:59.187935 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:59.189103 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:34:59.872351 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:07.644356 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:07.827315 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:INSERT=30,nova_cell0:SELECT=31,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:07.871596 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:08.960236 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:08.969903 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:09.036803 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:09.038639 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:09.122999 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:09.123367 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:09.170465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:09.172852 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:09.206107 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:09.208748 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:09.371143 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:09.372937 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:09.373536 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:09.391417 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:09.391417 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:09.391417 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:09.391417 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:09.391417 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:09.391417 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:09.391417 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:09.391417 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:09.393169 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:09.429637 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:09.431646 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:09.432060 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:09.454800 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:09.454800 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:09.454800 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:09.454800 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:09.454800 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:09.454800 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:09.454800 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:09.454800 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:09.455759 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:09.554807 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:09.555223 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:09.731820 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:09.737039 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:09.737713 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:09.773108 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:09.773108 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:09.773108 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:09.773108 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:09.773108 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:09.773108 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:09.773108 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:09.773108 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:09.774965 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:10.976598 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:10.978942 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:11.010156 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:11.010156 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:11.240590 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:11.242581 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:11.244526 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:11.264142 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:11.264142 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:11.264142 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:11.264142 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:11.264142 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:11.264142 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:11.264142 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:11.264142 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:11.265980 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:12.753208 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:12.755248 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:12.784462 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.784877 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.833155 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:INSERT=43,nova_cell0:SELECT=46,nova_cell0:UPDATE=11 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:12.973753 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:12.976554 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.977779 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.990869 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:12.990869 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:12.990869 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:12.990869 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:12.990869 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:12.990869 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:12.990869 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:12.990869 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:12.992176 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:19.911760 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:21.352964 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=40,nova_cell0:RELEASE=1,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:21.378709 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:21.380000 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:22.919312 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:23.050761 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:INSERT=17,nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:23.065555 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:25.621487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:25.623315 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:25.648274 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:25.651985 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:25.910536 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:25.912835 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:25.913487 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:25.930807 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:25.930807 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:25.930807 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:25.930807 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:25.930807 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:25.930807 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:25.930807 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:25.930807 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:25.933080 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:32.219173 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:32.220956 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:32.262011 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:32.262493 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:32.566273 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:32.568024 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:32.568785 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:32.597346 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:32.597346 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:32.597346 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:32.597346 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:32.597346 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:32.597346 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:32.597346 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:32.597346 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:32.599310 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:32.718495 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:32.718986 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:35.470280 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:35.472053 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:35.522500 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:35.528808 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:35.818850 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:35.820278 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:35.821113 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:35.838084 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:35.838084 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:35.838084 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:35.838084 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:35.838084 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:35.838084 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:35.838084 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:35.838084 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:35.840452 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:39.872347 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:41.150644 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:41.152849 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:41.189025 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:41.190190 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:41.486093 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:41.488686 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:41.489453 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:41.513669 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:41.513669 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:41.513669 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:41.513669 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:41.513669 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:41.513669 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:41.513669 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:41.513669 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:41.514784 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:45.233793 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:45.235521 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:45.258157 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:45.258565 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:45.343708 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=51,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:45.493325 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:45.495371 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:45.495962 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:45.510628 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:45.510628 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:45.510628 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:45.510628 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:45.510628 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:45.510628 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:45.510628 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:45.510628 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:45.512115 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:46.658230 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:46.660160 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:46.686205 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:46.687548 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:46.729169 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=41,nova_cell0:INSERT=38,nova_cell0:UPDATE=19,nova_cell0:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:47.013416 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:47.015038 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:47.016868 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:47.041885 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:47.041885 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:47.041885 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:47.041885 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:47.041885 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:47.041885 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:47.041885 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:47.041885 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:47.043543 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:54.818183 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:54.823460 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:54.850755 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:54.860197 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:55.042286 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:55.043654 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:35:55.061240 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:55.064340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:35:55.072865 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:55.076626 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:55.085763 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:55.086420 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:55.276094 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] block_device_mapping [BlockDeviceMapping(attachment_id=d71db293-7919-4f85-b284-b1023bdd7f11,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69f5f13e-d5d2-489c-a478-6c6db9329e33',volume_size=1,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:55.279852 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:55.284521 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:55.303830 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:55.303830 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:35:55.303830 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:55.303830 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:35:55.303830 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:55.303830 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:35:55.303830 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:55.303830 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:55.305784 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:55.318975 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:35:55.321004 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:55.321486 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:55.354330 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:35:55.354330 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:35:55.354330 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:35:55.354330 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:35:55.354330 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:35:55.354330 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:35:55.354330 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:35:55.354330 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:55.358797 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:35:59.905709 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:36:02.160855 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:02.164193 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:02.184450 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:02.185106 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:02.351359 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:36:02.352764 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:02.354593 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:02.368816 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:36:02.368816 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:36:02.368816 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:02.368816 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:36:02.368816 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:02.368816 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:36:02.368816 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:02.368816 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:02.369794 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:02.413045 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:INSERT=45,nova_cell0:SELECT=44,nova_cell0:UPDATE=11 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:05.195402 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:05.355401 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:INSERT=37,nova_cell0:SELECT=31,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:05.376972 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:36:07.805330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:07.807645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:07.838679 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:07.840735 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:08.043275 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:36:08.044577 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:08.044987 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:08.074967 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:36:08.074967 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:36:08.074967 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:08.074967 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:36:08.074967 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:08.074967 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:36:08.074967 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:08.074967 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:08.077012 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:12.451305 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=1,nova_cell0:INSERT=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:12.454432 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=9 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:12.455277 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:17.976955 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:18.160334 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:18.189151 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:19.883788 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:19.917011 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:36:28.253514 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:28.256251 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:28.310316 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:28.311802 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:28.501359 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:36:28.502828 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:28.503417 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:28.526412 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:36:28.526412 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:36:28.526412 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:28.526412 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:36:28.526412 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:28.526412 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:36:28.526412 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:28.526412 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:28.527495 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:36:28.933727 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:28.935651 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:28.997109 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:29.021440 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:29.300144 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:36:29.308647 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:29.309497 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:29.340527 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:36:29.340527 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:36:29.340527 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:29.340527 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:36:29.340527 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:29.340527 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:36:29.340527 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:29.340527 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:29.342856 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:36:33.915505 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:33.917491 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:33.944744 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:33.950571 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:34.137577 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:36:34.148367 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:34.149239 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:34.167038 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:36:34.167038 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:36:34.167038 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:34.167038 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:36:34.167038 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:34.167038 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:36:34.167038 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:34.167038 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:34.171085 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:39.145138 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:39.422862 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:39.451192 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:44.060598 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:44.246764 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=40,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:44.272044 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:36:50.307286 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:50.309555 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:50.328797 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:50.329225 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:50.525511 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:36:50.530609 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:50.533184 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:50.559203 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:36:50.559203 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:36:50.559203 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:50.559203 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:36:50.559203 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:50.559203 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:36:50.559203 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:50.559203 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:50.560828 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:36:51.756161 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:51.758012 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:36:51.782030 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:51.787420 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:51.997168 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:36:52.000816 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:52.002688 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:52.043410 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:36:52.043410 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:36:52.043410 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:52.043410 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:36:52.043410 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:52.043410 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:36:52.043410 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:52.043410 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:52.045557 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:36:54.754783 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:54.756663 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:36:54.780613 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:54.781130 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:55.049927 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:36:55.051407 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:55.051828 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:55.077166 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:36:55.077166 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:36:55.077166 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:36:55.077166 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:36:55.077166 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:36:55.077166 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:36:55.077166 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:36:55.077166 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:55.078862 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:36:59.886269 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:59.911520 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:01.913245 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:02.105369 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:02.137190 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:04.972022 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:05.157129 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=34,nova_cell0:INSERT=38,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:05.184043 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:37:21.076579 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:21.078687 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:21.100426 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:21.100843 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:21.321365 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:37:21.323607 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:21.324333 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:21.336697 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:37:21.336697 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:21.336697 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:21.336697 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:21.336697 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:21.336697 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:21.336697 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:21.336697 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:21.340628 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:31.396780 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:31.431885 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:31.435995 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:37:38.178201 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:38.180374 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:38.211328 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:38.211764 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:38.550121 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:37:38.555175 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:38.557401 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:38.576039 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:37:38.576039 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:37:38.576039 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:38.576039 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:37:38.576039 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:38.576039 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:37:38.576039 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:38.576039 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:38.578590 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:39.884647 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:39.914371 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:37:43.163038 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:43.165808 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:43.202275 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:43.202685 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:43.398193 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:37:43.402959 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:43.404149 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:43.420710 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:37:43.420710 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:43.420710 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:43.420710 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:43.420710 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:43.420710 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:43.420710 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:43.420710 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:43.437327 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:37:46.367322 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:46.368585 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:46.401352 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:46.402137 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:46.669665 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:37:46.671228 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:46.671859 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:46.708587 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:37:46.708587 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:37:46.708587 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:46.708587 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:37:46.708587 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:46.708587 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:37:46.708587 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:46.708587 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:46.713269 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:37:50.427299 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:50.428837 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:50.449122 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:50.452034 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:50.646311 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] block_device_mapping [BlockDeviceMapping(attachment_id=1d54e758-65d0-4d77-a94e-0d66871b7c8e,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='fce9258f-07ae-4eb8-9260-3b2ebc41e5b0',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=2fb13858-34fc-4d08-a5dc-c241ae54d154,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='48069353-764e-4675-9220-39c820e5fec5',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=085e2f1c-288a-46d1-9ce8-ae5338ce6f04,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca79a4f6-919a-4be5-9ea2-8485710f9a60',volume_size=1,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:37:50.648119 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:50.652999 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:50.661785 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:50.662445 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:50.673311 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:50.673968 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:50.685851 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:37:50.685851 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:50.685851 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:50.685851 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:50.685851 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:50.685851 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:50.685851 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:50.685851 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:50.688522 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:37:51.591155 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:51.592700 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:51.612556 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.618725 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.651924 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=53,nova_cell0:RELEASE=1,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:37:51.720137 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:51.721487 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:51.758331 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.761901 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.824402 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=39,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=49,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:51.849527 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:37:51.853105 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.854027 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.867548 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:37:51.867548 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:37:51.867548 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:51.867548 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:37:51.867548 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:51.867548 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:37:51.867548 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:51.867548 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:51.870328 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:51.990653 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:37:51.992490 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.993179 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:52.007367 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:37:52.007367 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:52.007367 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:52.007367 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:52.007367 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:52.007367 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:52.007367 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:52.007367 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:52.008323 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:37:56.041501 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:56.043003 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:37:56.064052 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:56.064721 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:56.246019 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:37:56.248101 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:56.248584 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:56.266525 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:37:56.266525 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:37:56.266525 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:56.266525 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:37:56.266525 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:56.266525 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:37:56.266525 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:56.266525 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:56.268522 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:37:56.498118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:56.499695 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:37:56.518909 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:56.524877 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:56.714422 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:37:56.715976 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:56.716546 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:56.728591 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:37:56.728591 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:37:56.728591 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:37:56.728591 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:37:56.728591 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:37:56.728591 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:37:56.728591 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:37:56.728591 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:37:56.729747 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:06.177134 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:06.353810 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:INSERT=24,nova_cell0:SELECT=31,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:06.372195 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:06.637453 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:06.798735 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:INSERT=31,nova_cell0:SELECT=31,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:06.823638 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:09.904237 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:19.915652 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:38:28.033683 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:28.035635 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:28.104307 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:28.106469 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:28.307768 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:38:28.312656 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:28.316205 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:28.345263 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:38:28.345263 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:38:28.345263 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:38:28.345263 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:38:28.345263 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:38:28.345263 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:38:28.345263 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:38:28.345263 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:28.356000 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:38:36.868369 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:38:36.869805 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:38:36.895417 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:36.895833 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:37.157939 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:38:37.162308 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:37.163006 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:37.181255 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:38:37.181255 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:38:37.181255 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:38:37.181255 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:38:37.181255 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:38:37.181255 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:38:37.181255 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:38:37.181255 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:37.184932 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:38.233135 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:38.479013 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:38.502619 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:39.927875 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:38:45.743014 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:45.744575 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:38:45.775897 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:45.776614 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:45.978722 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:38:45.980881 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:45.981905 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:46.003883 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:38:46.003883 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:38:46.003883 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:38:46.003883 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:38:46.003883 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:38:46.003883 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:38:46.003883 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:38:46.003883 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:46.006933 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:38:47.061985 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:47.255670 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:47.281603 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:49.898193 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:56.080619 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:56.101174 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:56.103360 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:39:03.119238 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:03.120928 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:03.141934 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:03.142392 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:03.352103 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:39:03.355263 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:03.355890 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:03.374669 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:39:03.374669 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:39:03.374669 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:03.374669 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:39:03.374669 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:03.374669 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:39:03.374669 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:03.374669 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:03.378693 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:39:05.845330 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:05.846926 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:05.883086 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:05.886052 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:06.079358 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:39:06.080999 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:06.081569 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:06.103828 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:39:06.103828 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:39:06.103828 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:06.103828 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:39:06.103828 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:06.103828 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:39:06.103828 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:06.103828 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:06.104898 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:39:07.944466 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:07.945995 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:07.975184 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:07.975605 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:08.224034 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:39:08.228137 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:08.228755 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:08.252522 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:39:08.252522 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:39:08.252522 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:08.252522 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:39:08.252522 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:08.252522 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:39:08.252522 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:08.252522 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:08.254370 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:39:09.451403 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:09.453455 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:09.475825 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:09.476531 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:09.678755 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:39:09.680160 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:09.680642 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:09.695827 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:39:09.695827 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:39:09.695827 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:09.695827 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:39:09.695827 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:09.695827 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:39:09.695827 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:09.695827 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:09.696820 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:09.901326 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:18.133173 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=10 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:18.341565 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=40,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:18.361055 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:19.763659 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=34,nova_cell0:INSERT=38,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:19.777733 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:19.797200 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:19.909053 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:39:49.751795 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:49.753929 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:49.783063 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:49.784176 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:49.926699 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:50.041013 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:39:50.044336 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:50.044759 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:50.071450 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:39:50.071450 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:39:50.071450 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:50.071450 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:39:50.071450 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:50.071450 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:39:50.071450 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:50.071450 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:50.072460 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:39:52.067202 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:52.068836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:39:52.111825 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:52.114425 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:52.345516 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] block_device_mapping [BlockDeviceMapping(attachment_id=80b7aaa4-64d1-4be3-af7f-d7adee6e4370,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e08d6d6f-be47-4de3-a316-a49aa294ba25',volume_size=1,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:39:52.351855 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:52.356637 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:52.380707 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:39:52.380707 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:39:52.380707 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:52.380707 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:39:52.380707 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:52.380707 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:39:52.380707 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:52.380707 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:52.384143 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:39:53.176432 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:53.178337 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:39:53.195842 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:53.195842 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:53.425462 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:39:53.437500 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:53.439536 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:53.472523 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:39:53.472523 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:39:53.472523 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:39:53.472523 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:39:53.472523 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:39:53.472523 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:39:53.472523 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:39:53.472523 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:53.473479 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:39:59.912166 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:02.267663 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:02.487546 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:02.516201 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:03.343574 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:03.523624 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=40,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:03.532622 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:16.862036 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:16.863925 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:16.882110 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:16.882840 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:17.094546 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:17.097119 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:17.099326 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:17.126614 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:17.126614 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:17.126614 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:17.126614 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:17.126614 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:17.126614 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:17.126614 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:17.126614 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:17.128654 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:17.220761 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:17.222305 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:17.246743 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:17.247760 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:17.419526 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:17.425059 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:17.425495 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:17.454196 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:17.454196 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:17.454196 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:17.454196 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:17.454196 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:17.454196 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:17.454196 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:17.454196 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:17.455163 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:18.024056 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:18.025506 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:18.049812 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.062173 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.308315 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:18.309753 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.310296 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.334389 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:18.334389 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:18.334389 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:18.334389 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:18.334389 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:18.334389 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:18.334389 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:18.334389 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:18.335918 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:18.688961 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:18.690508 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:18.725064 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.725755 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.896766 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:18.898139 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.898556 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.917473 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:18.917473 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:18.917473 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:18.917473 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:18.917473 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:18.917473 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:18.917473 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:18.917473 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:18.919841 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:27.330836 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:27.332724 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:27.355028 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:27.355743 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:27.405853 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=51,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:27.516129 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:27.520560 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:27.521295 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:27.535831 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:27.535831 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:27.535831 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:27.535831 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:27.535831 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:27.535831 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:27.535831 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:27.535831 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:27.537771 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:28.795847 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:28.978188 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=39,nova_cell0:RELEASE=1,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:29.005947 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:29.910771 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:30.820406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:30.821582 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:30.847959 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:30.848462 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:31.048043 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:31.050409 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:31.051523 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:31.066671 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:31.066671 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:31.066671 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:31.066671 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:31.066671 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:31.066671 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:31.066671 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:31.066671 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:31.068736 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:35.819944 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:35.821655 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:35.841547 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:35.842701 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:35.957143 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:35.967341 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:35.968158 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:35.984913 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:35.984913 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:35.984913 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:35.984913 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:35.984913 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:35.984913 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:35.984913 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:35.984913 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:35.988983 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:38.730819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:38.733125 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:38.751679 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:38.752130 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:38.940505 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:38.945492 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:38.947703 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:38.964612 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:38.964612 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:38.964612 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:38.964612 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:38.964612 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:38.964612 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:38.964612 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:38.964612 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:38.967113 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:39.437580 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:39.439945 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:39.468150 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:39.468826 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:39.669222 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 5b1d6d0e-deb1-4029-9c03-9aace5e9704f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:39.672510 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:39.675257 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:39.707054 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:39.707054 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:39.707054 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:39.707054 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:39.707054 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:39.707054 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:39.707054 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:39.707054 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:39.711508 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 5b1d6d0e-deb1-4029-9c03-9aace5e9704f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:39.746462 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:INSERT=45,nova_cell0:SELECT=44,nova_cell0:UPDATE=11 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:39.819586 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:39.820015 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:39.923430 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:42.379710 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:42.381331 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:42.400342 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:42.400962 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:42.433581 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=53,nova_cell0:RELEASE=1,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:42.542611 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:42.544426 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:42.547608 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:42.565895 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:42.565895 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:42.565895 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:42.565895 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:42.565895 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:42.565895 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:42.565895 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:42.565895 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:42.568206 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:47.503075 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:47.507631 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:47.648552 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:47.649992 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:47.669701 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:47.671270 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:47.863336 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:47.864938 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:47.865396 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:47.879206 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:47.879206 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:47.879206 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:47.879206 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:47.879206 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:47.879206 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:47.879206 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:47.879206 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:47.882239 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:52.614130 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:INSERT=5,nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:52.632861 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:52.637894 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:53.082878 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:53.084536 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:40:53.121116 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:53.121693 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:53.321607 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:53.323719 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:53.324502 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:53.339044 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:53.339044 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:40:53.339044 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:53.339044 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:40:53.339044 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:53.339044 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:40:53.339044 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:53.339044 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:53.341470 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:57.958950 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=25,nova_cell0:UPDATE=16,nova_cell0:INSERT=20,nova_cell0:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:57.990817 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:57.991738 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:40:58.422367 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:58.423620 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:40:58.454582 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:58.455145 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:58.633688 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:40:58.635093 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:58.635518 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:58.660403 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:40:58.660403 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:40:58.660403 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:40:58.660403 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:40:58.660403 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:40:58.660403 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:40:58.660403 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:40:58.660403 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:58.661956 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:40:59.923779 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:03.397702 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:03.422483 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:03.425699 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:08.557845 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:08.805107 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:08.827499 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:41:10.254601 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:41:10.256118 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:41:10.282260 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:10.284256 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:10.531845 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:41:10.533643 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:10.534255 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:10.557363 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:41:10.557363 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:41:10.557363 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:41:10.557363 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:41:10.557363 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:41:10.557363 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:41:10.557363 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:41:10.557363 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:41:10.559438 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:41:18.772908 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:41:18.774669 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:41:18.793402 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:18.793823 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:18.944035 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:41:18.945814 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:18.946456 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:18.959824 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:41:18.959824 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:41:18.959824 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:41:18.959824 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:41:18.959824 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:41:18.959824 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:41:18.959824 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:41:18.959824 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:41:18.961909 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:41:19.933653 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:20.460304 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:20.623175 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:20.645006 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:29.004899 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:29.019713 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:29.020633 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:39.937277 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:49.956366 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:42:09.934962 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:42:29.937187 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:42:49.918731 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:09.932722 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:29.920329 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:30.830317 n-d-850468-6 nova-conductor[110966]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [37a1b5bc-ce5f-4b86-8271-e60f9e966e6e] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:43:31.412788 n-d-850468-6 nova-conductor[110967]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [d05db21a-a71e-4fe1-ae94-e85577155c06] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:43:31.849234 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [37a1b5bc-ce5f-4b86-8271-e60f9e966e6e] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 60638. Jul 28 10:43:32.436778 n-d-850468-6 nova-conductor[110967]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [d05db21a-a71e-4fe1-ae94-e85577155c06] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 60656. Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:43:32.974733 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:32.976616 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:32.991965 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:32.992712 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.140034 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:43:33.158113 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:33.160189 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.183464 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:43:33.183464 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:43:33.183464 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:43:33.183464 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:43:33.183464 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:43:33.183464 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:43:33.183464 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:43:33.183464 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:33.185614 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:43:33.272718 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:33.274282 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:43:33.292016 n-d-850468-6 nova-conductor[110966]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [2d789625-8812-401e-8aff-de63f4e86db7] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:43:33.330915 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:33.332248 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.531621 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:43:33.532964 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:33.533639 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.561229 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:43:33.561229 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:43:33.561229 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:43:33.561229 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:43:33.561229 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:43:33.561229 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:43:33.561229 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:43:33.561229 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:33.563016 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:43:34.030308 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:43:34.032181 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:43:34.047424 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.048060 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.266653 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] block_device_mapping [BlockDeviceMapping(attachment_id=23998f35-05b3-4b1a-ba69-a26948f26904,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='955f001a-3f58-4db4-827e-0bf0900c07b9',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=faa56928-42cc-4cbb-be97-8ad002d2c179,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='95263a26-447d-4a19-a671-bf511c5274af',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=26b4bf7b-5d5c-45c6-af63-7b07112e2a7a,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='269407a8-8b85-4388-bc68-a6a952fec516',volume_size=1,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:43:34.266926 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.267881 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.286158 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.287741 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.301477 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [2d789625-8812-401e-8aff-de63f4e86db7] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 60708. Jul 28 10:43:34.325603 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.326331 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.341053 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:43:34.341053 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:43:34.341053 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:43:34.341053 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:43:34.341053 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:43:34.341053 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:43:34.341053 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:43:34.341053 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:34.342170 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:43:34.424655 n-d-850468-6 nova-conductor[110967]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [a7dc5b4a-8f21-4e61-982d-76040b269fd0] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:43:35.455588 n-d-850468-6 nova-conductor[110967]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [a7dc5b4a-8f21-4e61-982d-76040b269fd0] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 60760. Jul 28 10:43:43.442288 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:43.616886 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=40,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:44.316852 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:44.409988 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=19,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=22,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:45.497003 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=7 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:45.509390 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:49.947615 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:09.920988 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:29.929355 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:29.932767 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:45:01.750069 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:01.752242 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:01.767943 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:01.768368 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:01.966661 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:45:01.968121 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:01.968559 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:01.984821 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:45:01.984821 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:45:01.984821 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:45:01.984821 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:45:01.984821 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:45:01.984821 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:45:01.984821 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:45:01.984821 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:01.985898 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:45:06.196325 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:45:06.198383 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:45:06.230210 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:06.238663 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:06.506899 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:45:06.508457 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:06.508882 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:06.528824 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:45:06.528824 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:45:06.528824 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:45:06.528824 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:45:06.528824 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:45:06.528824 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:45:06.528824 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:45:06.528824 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:06.530134 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:09.927976 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:09.942496 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:12.081266 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:12.106723 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:12.110528 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:16.230143 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:16.650669 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:16.689545 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:49.931033 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:49.949363 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:45:51.251396 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:51.253340 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:45:51.277596 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:51.278311 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:51.468466 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:45:51.470870 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:51.471637 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:51.498902 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:45:51.498902 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:45:51.498902 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:45:51.498902 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:45:51.498902 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:45:51.498902 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:45:51.498902 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:45:51.498902 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:45:51.501152 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:01.592105 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:01.611712 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:01.613266 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:29.930905 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:29.961144 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:46:45.750823 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:46:45.752246 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:46:45.846152 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:45.846573 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:46:45.860474 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:46:45.862292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:46:45.901542 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:45.902154 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:46.064225 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:46:46.065579 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:46.066125 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:46.085646 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:46:46.085646 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:46:46.085646 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:46:46.085646 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:46:46.085646 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:46:46.085646 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:46:46.085646 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:46:46.085646 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:46.087101 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:46.227870 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:46.229108 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:46.251458 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] block_device_mapping [BlockDeviceMapping(attachment_id=f4bed66f-3865-4a7a-806f-319dd9bc5986,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2fe40e2-e69e-434c-8219-756966d318b2',volume_size=1,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:46:46.253293 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:46.255263 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:46.285393 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:46:46.285393 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:46:46.285393 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:46:46.285393 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:46:46.285393 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:46:46.285393 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:46:46.285393 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:46:46.285393 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:46.288478 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:46.406991 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:46:46.408583 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:46.413179 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:46.433796 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:46:46.433796 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:46:46.433796 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:46:46.433796 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:46:46.433796 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:46:46.433796 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:46:46.433796 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:46:46.433796 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:46.435700 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:46.520488 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:46.520989 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:46.586150 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=37,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=53,nova_cell0:RELEASE=1,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:46.732985 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:46:46.734680 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:46.735308 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:46.753507 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:46:46.753507 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:46:46.753507 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:46:46.753507 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:46:46.753507 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:46:46.753507 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:46:46.753507 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:46:46.753507 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:46.756206 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:46:53.640668 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:46:56.438638 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=14,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:56.464291 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=6 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:56.467285 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:56.799776 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:INSERT=5,nova_cell0:SELECT=14,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:56.851330 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:56.853660 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:59.945576 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:47:01.097511 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:47:01.099677 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:47:01.147702 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:01.148567 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:01.373298 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] block_device_mapping [BlockDeviceMapping(attachment_id=d5611b35-6295-4c0e-b52b-7940f98795b9,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d115eec-8e68-43bc-812c-6d743e46df9b',volume_size=1,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:47:01.374377 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:01.375087 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:01.390422 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:47:01.390422 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:47:01.390422 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:47:01.390422 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:47:01.390422 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:47:01.390422 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:47:01.390422 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:47:01.390422 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:47:01.391411 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:47:09.950484 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:11.146578 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:11.458879 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=13,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:11.487668 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:19.953210 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:47:39.499357 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:47:39.501087 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:47:39.567012 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:39.568270 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:39.791970 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:47:39.793695 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:39.794344 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:39.811909 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:47:39.811909 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:47:39.811909 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:47:39.811909 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:47:39.811909 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:47:39.811909 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:47:39.811909 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:47:39.811909 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:47:39.813664 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:47:39.954858 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:49.506645 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:49.916130 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:49.944655 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:59.955809 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:48:03.001404 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:48:03.003996 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:48:03.028101 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:03.028531 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:03.273600 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='60120312-4e36-4500-8dd3-ac2b308b5fc1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:48:03.274922 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:03.275339 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:03.287117 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:48:03.287117 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:48:03.287117 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:48:03.287117 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:48:03.287117 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:48:03.287117 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:48:03.287117 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:48:03.287117 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:48:03.288047 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:48:13.174812 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:13.356055 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=18,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:13.404003 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:19.972102 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:39.962123 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:59.968946 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:06.673365 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:06.680638 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:06.684481 n-d-850468-6 nova-conductor[110967]: INFO dbcounter [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Registered counter for database nova_cell1 Jul 28 10:49:06.708745 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_db.sqlalchemy.engines [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110967) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:49:06.723412 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writer thread running {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:49:07.003473 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:07.004868 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:07.026193 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:07.041023 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:07.263668 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:49:07.264932 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:07.265369 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:07.282767 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:49:07.282767 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:49:07.282767 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:07.282767 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:49:07.282767 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:07.282767 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:49:07.282767 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:07.282767 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:07.283900 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:49:10.101985 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:10.103539 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:10.128311 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:10.128806 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:10.393570 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] block_device_mapping [BlockDeviceMapping(attachment_id=da2770b1-6275-4178-aeff-545ff290fc51,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db601ed9-c8cd-448b-882a-6fd2833791e2',volume_size=1,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:49:10.400491 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:10.401438 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:10.420555 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:49:10.420555 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:49:10.420555 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:10.420555 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:49:10.420555 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:10.420555 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:49:10.420555 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:10.420555 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:10.424444 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:16.726811 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell1:SELECT=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:17.175432 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:17.363504 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:17.392727 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:19.974178 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:20.316204 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:20.510114 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=18,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:20.538669 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:29.989691 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:49:42.203920 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:42.205779 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:49:42.226313 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:42.226790 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:42.526817 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:49:42.528705 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:42.531438 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:42.568437 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:49:42.568437 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:49:42.568437 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:42.568437 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:49:42.568437 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:42.568437 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:49:42.568437 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:42.568437 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:42.569527 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:49:44.810507 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:44.812887 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:49:44.851068 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:44.851068 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:45.093585 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:49:45.095821 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:45.096428 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:45.113144 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:49:45.113144 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:49:45.113144 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:49:45.113144 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:49:45.113144 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:49:45.113144 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:49:45.113144 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:49:45.113144 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:45.114461 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:49:49.971591 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:52.467208 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:52.650217 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:52.691315 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:55.025603 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:55.193609 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:55.213450 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:59.986123 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:50:08.032280 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:50:08.034007 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:50:08.137716 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:08.139447 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:08.428014 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] block_device_mapping [BlockDeviceMapping(attachment_id=5f0b5d4d-fbd2-4679-b176-ad7c626ddf26,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4803d67f-74ce-4b3e-b9b4-076361f26c3e',volume_size=1,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:50:08.429737 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:08.430402 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:08.451033 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:50:08.451033 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:50:08.451033 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:50:08.451033 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:50:08.451033 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:50:08.451033 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:50:08.451033 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:50:08.451033 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:50:08.453187 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:50:13.651734 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:50:18.320547 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:18.543044 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=18,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:18.620612 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:29.985939 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:39.994322 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=2 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:09.984093 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:51:13.631757 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:13.633390 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:13.660314 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:13.663011 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:13.864249 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:51:13.867577 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:13.868607 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:13.900273 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:51:13.900273 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:51:13.900273 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:13.900273 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:51:13.900273 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:13.900273 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:51:13.900273 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:13.900273 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:13.903229 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:19.998695 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:23.977400 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:23.988753 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:23.989684 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:51:30.515331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:30.517267 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:30.541625 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:30.545186 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:30.762375 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:51:30.765235 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:30.766928 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:30.783522 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:51:30.783522 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:51:30.783522 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:30.783522 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:51:30.783522 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:30.783522 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:51:30.783522 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:30.783522 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:30.785192 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:51:34.679517 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:34.682139 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:34.734149 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:34.740503 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:34.952460 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:51:34.954127 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:34.955107 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:34.987077 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:51:34.987077 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:51:34.987077 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:34.987077 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:51:34.987077 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:34.987077 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:51:34.987077 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:34.987077 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:34.991065 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:51:38.234970 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:38.236798 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:51:38.252354 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:38.252772 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:38.477581 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:51:38.479941 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:38.481239 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:38.500332 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:51:38.500332 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:51:38.500332 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:38.500332 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:51:38.500332 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:38.500332 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:51:38.500332 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:38.500332 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:38.502328 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:51:42.039779 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:42.042371 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:51:42.065715 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:42.077565 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:42.273469 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:51:42.275902 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:42.276765 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:42.294495 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:51:42.294495 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:51:42.294495 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:51:42.294495 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:51:42.294495 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:51:42.294495 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:51:42.294495 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:51:42.294495 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:42.296858 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:51:48.254493 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:48.592382 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=34,nova_cell0:INSERT=38,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:48.609159 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:50.001967 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:52.192797 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:52.378788 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=2,nova_cell0:INSERT=40,nova_cell0:RELEASE=2,nova_cell0:UPDATE=8 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:52.415398 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:52:00.007870 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:52:30.004196 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:52:40.010999 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:00.026020 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:10.042258 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:53:12.737105 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:53:12.738869 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:53:12.753269 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:12.753703 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:12.913289 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:53:12.917071 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:12.918042 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:12.945341 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:53:12.945341 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:53:12.945341 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:53:12.945341 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:53:12.945341 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:53:12.945341 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:53:12.945341 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:53:12.945341 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:53:12.947039 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:53:22.851396 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:22.990862 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:23.005949 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:53:28.918753 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:53:28.920771 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:53:28.941724 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:28.943125 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:29.102154 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:53:29.104550 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:29.105218 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:29.116860 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:53:29.116860 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:53:29.116860 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:53:29.116860 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:53:29.116860 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:53:29.116860 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:53:29.116860 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:53:29.116860 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:53:29.119880 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:53:30.037754 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:33.686223 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:53:39.043697 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:39.205161 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:39.235116 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:50.033590 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:54:04.409661 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:54:04.411907 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:54:04.429450 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:04.433023 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:04.543085 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:54:04.545126 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:04.546040 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:04.560315 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:54:04.560315 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:54:04.560315 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:54:04.560315 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:54:04.560315 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:54:04.560315 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:54:04.560315 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:54:04.560315 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:54:04.561845 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:54:10.027488 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:14.488933 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:14.609655 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:14.625658 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:30.031854 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:40.042732 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:54:52.606406 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:54:52.608398 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:54:52.634029 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:52.634608 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:52.858045 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:54:52.859876 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:52.860558 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:52.879176 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:54:52.879176 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:54:52.879176 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:54:52.879176 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:54:52.879176 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:54:52.879176 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:54:52.879176 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:54:52.879176 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:54:52.880971 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:55:02.950326 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=23,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:55:02.980030 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:55:02.980810 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:55:10.046299 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:55:20.043134 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:55:50.045348 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:00.042155 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:20.039444 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:56:25.951025 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:56:25.952391 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:56:25.962532 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:25.963057 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:26.149552 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:56:26.151458 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:26.152119 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:26.172240 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:56:26.172240 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:56:26.172240 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:56:26.172240 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:56:26.172240 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:56:26.172240 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:56:26.172240 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:56:26.172240 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:56:26.174020 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:56:36.072128 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:36.212885 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:36.235516 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:40.039022 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:56:45.886689 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:56:45.888273 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:56:45.908496 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:45.910891 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:46.087997 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:56:46.089714 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:46.090446 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:46.103610 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:56:46.103610 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:56:46.103610 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:56:46.103610 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:56:46.103610 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:56:46.103610 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:56:46.103610 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:56:46.103610 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:56:46.108310 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:56:53.696161 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:56:56.022533 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:56.180475 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:56.201413 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:00.044358 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:57:04.410712 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:04.413274 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:04.426256 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:04.426669 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:04.607573 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:57:04.608767 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:04.609188 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:04.628192 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:57:04.628192 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:57:04.628192 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:57:04.628192 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:57:04.628192 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:57:04.628192 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:57:04.628192 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:57:04.628192 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:04.629820 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:14.521088 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:14.663931 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:14.682144 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:20.048097 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:57:20.539819 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:57:20.541454 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 10:57:20.574142 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:20.574142 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:20.693081 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:57:20.694942 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:20.695492 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:20.715223 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:57:20.715223 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 10:57:20.715223 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:57:20.715223 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 10:57:20.715223 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:57:20.715223 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 10:57:20.715223 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:57:20.715223 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:20.715223 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:30.630965 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:30.745707 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:30.758263 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:40.050804 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=3,nova_cell0:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:40.056177 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 10:57:54.086465 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:54.088210 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 10:57:54.101275 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:54.101695 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:54.185031 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] block_device_mapping [BlockDeviceMapping(attachment_id=97e04c4d-3db5-4d89-9c92-375b607a060c,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7222b33-d0c9-468b-be44-f66a0b7631eb',volume_size=1,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 10:57:54.186355 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:54.186768 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:54.193169 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 10:57:54.193169 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 10:57:54.193169 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 10:57:54.193169 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 10:57:54.193169 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 10:57:54.193169 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 10:57:54.193169 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 10:57:54.193169 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:57:54.194157 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 10:58:00.069823 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=4,nova_cell0:UPDATE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:58:04.150627 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=6 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:58:04.220867 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=19,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:58:04.233508 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:58:20.054849 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:58:40.060203 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:00.064760 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:20.061506 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:40.066831 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:50.075370 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:02.094885 n-d-850468-6 nova-conductor[110966]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [37a1b5bc-ce5f-4b86-8271-e60f9e966e6e] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 11:00:03.101788 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [37a1b5bc-ce5f-4b86-8271-e60f9e966e6e] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 56356. Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:00:04.181184 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:04.182950 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:04.192103 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:04.192523 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:04.282046 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:00:04.284139 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:04.284139 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:04.293630 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:00:04.293630 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:00:04.293630 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:04.293630 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:00:04.293630 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:04.293630 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:00:04.293630 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:04.293630 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:04.296014 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:04.332107 n-d-850468-6 nova-conductor[110966]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [2d789625-8812-401e-8aff-de63f4e86db7] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 11:00:05.339078 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [2d789625-8812-401e-8aff-de63f4e86db7] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 56368. Jul 28 11:00:13.705518 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:00:14.324489 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:15.345639 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:15.346433 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:20.076389 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:00:20.411292 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:20.413029 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:20.422345 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:20.422767 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:20.501098 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:00:20.502285 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:20.502705 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:20.509288 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:00:20.509288 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:00:20.509288 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:20.509288 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:00:20.509288 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:20.509288 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:00:20.509288 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:20.509288 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:20.510252 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:00:28.915351 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:28.917168 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:28.927429 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:28.927875 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:29.008987 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:00:29.010162 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:29.010579 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:29.017643 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:00:29.017643 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:00:29.017643 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:29.017643 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:00:29.017643 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:29.017643 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:00:29.017643 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:29.017643 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:29.018572 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:30.074754 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:30.471569 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:30.536676 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:30.548672 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:39.051266 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:39.060266 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:39.061539 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:00:40.325968 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:40.327645 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:40.342601 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:40.343023 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:40.428032 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:00:40.429943 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:40.430398 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:40.438106 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:00:40.438106 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:00:40.438106 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:40.438106 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:00:40.438106 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:40.438106 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:00:40.438106 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:40.438106 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:40.439076 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:00:42.600453 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:42.602354 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:00:42.613237 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:42.613740 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:42.696066 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:00:42.697439 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:42.697899 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:42.705301 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:00:42.705301 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:00:42.705301 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:42.705301 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:00:42.705301 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:42.705301 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:00:42.705301 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:42.705301 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:42.706429 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:50.468051 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:50.478606 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:50.479825 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:52.658831 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:52.740147 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:52.750598 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:00:55.055214 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:55.057064 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:00:55.068974 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:55.069752 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:55.156593 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:00:55.158499 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:55.159040 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:55.166428 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:00:55.166428 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:00:55.166428 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:00:55.166428 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:00:55.166428 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:00:55.166428 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:00:55.166428 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:00:55.166428 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:00:55.167392 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:00.090002 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:05.203255 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:05.212921 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:05.213914 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:01:06.388825 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:06.390400 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:06.391442 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:06.476154 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:01:06.477419 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:06.477839 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:06.486012 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:01:06.486012 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:01:06.486012 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:06.486012 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:01:06.486012 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:06.486012 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:01:06.486012 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:06.486012 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:06.486972 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:10.073629 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:16.518183 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:16.529570 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:16.531566 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:40.078135 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=3 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:40.081811 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=3 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:01:40.820887 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:40.822452 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:40.832098 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:40.832721 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:40.911569 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:01:40.912760 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:40.913175 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:40.920111 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:01:40.920111 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:01:40.920111 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:40.920111 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:01:40.920111 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:40.920111 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:01:40.920111 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:40.920111 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:40.921080 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:01:43.069272 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:43.071141 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:01:43.086583 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:43.086583 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:43.200896 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:01:43.202354 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:43.203132 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:43.211346 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:01:43.211346 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:01:43.211346 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:43.211346 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:01:43.211346 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:43.211346 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:01:43.211346 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:43.211346 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:43.212872 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:01:45.314323 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:45.316711 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:01:45.326838 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:45.327254 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:45.399870 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:01:45.401149 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:45.401574 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:45.408421 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:01:45.408421 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:01:45.408421 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:01:45.408421 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:01:45.408421 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:01:45.408421 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:01:45.408421 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:01:45.408421 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:45.409372 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:01:53.243878 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:53.257235 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:53.258192 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:55.434919 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=34,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=39,nova_cell0:RELEASE=1,nova_cell0:UPDATE=8 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:55.445393 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:55.446380 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:02:14.392675 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:14.394777 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:14.403899 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:14.404320 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:14.488107 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='756091b7-20d8-4946-bc5e-39172f8e0a20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:02:14.489263 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:14.489677 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:14.496221 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:02:14.496221 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:02:14.496221 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:14.496221 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:02:14.496221 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:14.496221 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:02:14.496221 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:14.496221 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:14.497199 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:20.080275 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:20.093191 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:24.458667 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:24.522758 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=20,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=17,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:24.540100 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:02:25.346484 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:25.348249 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:25.357953 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:25.358365 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:25.436928 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20502aec-8430-4ae9-b63f-31d38e0d4baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:02:25.438154 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:25.438567 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:25.445449 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:02:25.445449 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:02:25.445449 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:25.445449 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:02:25.445449 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:25.445449 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:02:25.445449 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:25.445449 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:25.446418 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:35.472643 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=20,nova_cell0:INSERT=16,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:35.482038 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:35.482817 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:02:42.835090 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:42.836822 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:02:42.847435 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:42.847934 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:42.931426 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:02:42.932616 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:42.933031 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:42.940499 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:02:42.940499 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:02:42.940499 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:42.940499 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:02:42.940499 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:42.940499 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:02:42.940499 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:42.940499 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:42.941450 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:52.900683 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:52.970599 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:52.979484 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:02:54.257331 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:54.259129 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:02:54.282445 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:54.284339 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:54.384425 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:02:54.386066 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:54.386499 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:54.394523 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:02:54.394523 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:02:54.394523 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:02:54.394523 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:02:54.394523 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:02:54.394523 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:02:54.394523 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:02:54.394523 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:02:54.395487 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:00.088055 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:00.089896 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:04.346807 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:04.430448 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:04.445170 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:03:05.432975 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:05.434860 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:05.447790 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:05.448300 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:05.528452 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:03:05.529829 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:05.530271 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:05.537294 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:03:05.537294 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:03:05.537294 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:05.537294 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:03:05.537294 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:05.537294 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:03:05.537294 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:05.537294 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:05.538538 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:15.567621 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:15.575377 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=7 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:15.576488 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:03:16.652781 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:16.654692 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:16.671659 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:16.672080 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:16.796707 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:03:16.799353 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:16.802002 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:16.817236 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:03:16.817236 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:03:16.817236 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:16.817236 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:03:16.817236 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:16.817236 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:03:16.817236 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:16.817236 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:16.818966 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:26.751697 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:26.854621 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:26.867885 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:03:27.878758 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:27.880289 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:03:27.894710 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:27.894710 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:27.966793 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:03:27.968142 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:27.968621 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:27.976160 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:03:27.976160 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:03:27.976160 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:27.976160 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:03:27.976160 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:27.976160 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:03:27.976160 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:27.976160 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:27.977115 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:33.714749 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:03:38.004042 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=19,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:38.013619 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:38.014244 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:40.097327 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:40.099027 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:03:46.136732 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:46.138694 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:03:46.149235 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:46.149656 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:46.231090 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:03:46.232345 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:46.232748 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:46.239521 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:03:46.239521 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:03:46.239521 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:03:46.239521 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:03:46.239521 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:03:46.239521 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:03:46.239521 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:03:46.239521 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:46.240479 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:03:56.268104 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:56.277424 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=6 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:56.278387 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:04:04.952186 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise result Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:04:04.954024 n-d-850468-6 nova-conductor[110966]: ERROR nova.conductor.manager Jul 28 11:04:04.962827 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:04.963241 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:05.041217 n-d-850468-6 nova-conductor[110966]: DEBUG nova.conductor.manager [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] block_device_mapping [BlockDeviceMapping(attachment_id=8d0da02b-9a3e-4781-8c58-3088755222ac,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c35ca08-5088-4f62-8f79-7d65e6bba165',volume_size=1,volume_type=None)] {{(pid=110966) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:04:05.042872 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:05.043296 n-d-850468-6 nova-conductor[110966]: DEBUG oslo_concurrency.lockutils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:05.052219 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:04:05.052219 n-d-850468-6 nova-conductor[110966]: Traceback (most recent call last): Jul 28 11:04:05.052219 n-d-850468-6 nova-conductor[110966]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:04:05.052219 n-d-850468-6 nova-conductor[110966]: return func(*args, **kwargs) Jul 28 11:04:05.052219 n-d-850468-6 nova-conductor[110966]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:04:05.052219 n-d-850468-6 nova-conductor[110966]: raise exception.NoValidHost(reason="") Jul 28 11:04:05.052219 n-d-850468-6 nova-conductor[110966]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:04:05.052219 n-d-850468-6 nova-conductor[110966]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:04:05.053358 n-d-850468-6 nova-conductor[110966]: WARNING nova.scheduler.utils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:04:15.005691 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:15.080428 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=17,nova_cell0:INSERT=18,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:15.090338 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:20.101887 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:20.104036 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=9,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 1554, in schedule_and_build_instances Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self._schedule_instances(context, request_specs[0], Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/manager.py", line 908, in _schedule_instances Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager host_lists = self.query_client.select_destinations( Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager result = self.transport._send( Jul 28 11:04:25.817730 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._driver.send(target, ctxt, message, Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise result Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Traceback (most recent call last): Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager return func(*args, **kwargs) Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager raise exception.NoValidHost(reason="") Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager nova.exception.NoValidHost: No valid host was found. Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:04:25.819623 n-d-850468-6 nova-conductor[110967]: ERROR nova.conductor.manager Jul 28 11:04:25.830164 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:25.830579 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:25.934354 n-d-850468-6 nova-conductor[110967]: DEBUG nova.conductor.manager [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=110967) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1406}} Jul 28 11:04:25.936927 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:25.937617 n-d-850468-6 nova-conductor[110967]: DEBUG oslo_concurrency.lockutils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:25.947667 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Failed to compute_task_build_instances: No valid host was found. Jul 28 11:04:25.947667 n-d-850468-6 nova-conductor[110967]: Traceback (most recent call last): Jul 28 11:04:25.947667 n-d-850468-6 nova-conductor[110967]: File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 28 11:04:25.947667 n-d-850468-6 nova-conductor[110967]: return func(*args, **kwargs) Jul 28 11:04:25.947667 n-d-850468-6 nova-conductor[110967]: File "/opt/stack/nova/nova/scheduler/manager.py", line 209, in select_destinations Jul 28 11:04:25.947667 n-d-850468-6 nova-conductor[110967]: raise exception.NoValidHost(reason="") Jul 28 11:04:25.947667 n-d-850468-6 nova-conductor[110967]: nova.exception.NoValidHost: No valid host was found. Jul 28 11:04:25.947667 n-d-850468-6 nova-conductor[110967]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:04:25.949504 n-d-850468-6 nova-conductor[110967]: WARNING nova.scheduler.utils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] Setting instance to ERROR state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. Jul 28 11:04:35.897233 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:UPDATE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.985031 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=17,nova_cell0:SAVEPOINT=1,nova_cell0:INSERT=20,nova_cell0:RELEASE=1,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.998655 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:00.107323 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:00.111537 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:40.109812 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:40.110563 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:20.112956 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:20.113567 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:53.723861 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:06:58.871808 n-d-850468-6 nova-conductor[110966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:06:59.238574 n-d-850468-6 nova-conductor[110967]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:07:00.029110 n-d-850468-6 nova-conductor[110967]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:07:00.119929 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:00.121364 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:40.125036 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:40.127482 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:08:20.127204 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:08:20.131374 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:09:00.133299 n-d-850468-6 nova-conductor[110966]: DEBUG dbcounter [-] [110966] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:09:00.136112 n-d-850468-6 nova-conductor[110967]: DEBUG dbcounter [-] [110967] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=4 {{(pid=110967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}